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Abstract — The  gradient  projection  anti-windup  (GPAW)  scheme 
was  recently  proposed  as  an  anti-windup  method  for  nonlin¬ 
ear  multi-input-multi-output  systems/controllers,  the  solution  of 
which  was  recognized  as  a  largely  open  problem  in  a  recent 
survey  paper.  This  report  analyzes  the  properties  of  the  GPAW 
scheme  applied  to  an  input  constrained  first  order  linear  time 
invariant  (LTI)  system  driven  by  a  first  order  LTI  controller, 
where  the  objective  is  to  regulate  the  system  state  about  the 
origin.  We  show  that  the  GPAW  compensated  system  is  in  fact 
a  projected  dynamical  system  (PDS),  and  use  results  in  the  PDS 
literature  to  assert  existence  and  uniqueness  of  its  solutions.  The 
main  result  is  that  the  GPAW  scheme  can  only  maintain/enlarge 
the  exact  region  of  attraction  of  the  uncompensated  system.  We 
illustrate  the  qualitative  weaknesses  of  some  results  in  estab¬ 
lishing  true  advantages  of  anti-windup  methods,  and  propose  a 
new  paradigm  to  address  the  anti-windup  problem,  where  results 
relative  to  the  uncompensated  system  are  sought. 

Index  Terms — gradient  projection  anti-windup,  constrained 
planar  LTI  systems,  projected  dynamical  systems,  equilibria, 
region  of  attraction. 

I.  Introduction 

HE  gradient  projection  anti-windup  (GPAW)  scheme 
was  proposed  in  [1]  as  an  anti-windup  method  for  non¬ 
linear  multi-input-multi-output  (MIMO)  systems/controllers. 
It  was  recognized  in  a  recent  survey  paper  [2]  that  anti¬ 
windup  compensation  for  nonlinear  systems  remains  largely  an 
open  problem.  To  this  end,  [3]  and  relevant  references  in  [2] 
represent  some  recent  advances.  The  GPAW  scheme  uses  a 
continuous-time  extension  of  the  gradient  projection  method  of 
nonlinear  programming  [4],  [5]  to  extend  the  “stop  integration” 
heuristic  outlined  in  [6]  to  the  case  of  nonlinear  MIMO 
systems/controllers.  Application  of  the  GPAW  scheme  to  some 
nominal  controllers  results  in  a  hybrid  GPAW  compensated 
controller  [1],  and  hence  a  hybrid  closed  loop  system. 
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Here,  we  apply  the  GPAW  scheme  to  a  first  order  linear 
time  invariant  (LTI)  system  stabilized  by  a  first  order  LTI 
controller,  where  the  objective  is  to  regulate  the  system  state 
about  the  origin.  This  case  is  particularly  insightful  because 
the  closed  loop  system  is  a  planar  dynamical  system  whose 
vector  field  is  easily  visualized,  and  is  highly  tractable  because 
there  is  a  large  body  of  relevant  work,  eg.  [7,  Chapter  2] 
[8,  Chapter  2]  [9,  Chapter  2]  [10,  Chapter  3]  [11],  Related 
literature  on  constrained  planar  systems  include  [12] — [18]. 

After  presenting  the  generalities  in  Section  II,  we  address 
the  existence  and  uniqueness  of  solutions  to  the  GPAW 
compensated  system.  Due  to  discontinuities  of  the  governing 
vector  field  of  the  GPAW  compensated  system  on  the  satura¬ 
tion  constraint  boundaries,  classical  existence  and  uniqueness 
results  based  on  Lipschitz  continuity  of  vector  fields  [7]— [  10] 
do  not  apply  directly.  We  show  that  the  GPAW  compensated 
system  is  in  fact  a  projected  dynamical  system  (PDS)  [  19]— [22] 
in  Section  III.  Observe  that  PDS  is  a  significant  line  of  inde¬ 
pendent  research  that  has  attracted  the  attention  of  economists 
and  mathematicians,  among  others.  The  link  to  PDS  thus 
enables  cross  utilization  of  ideas  and  methods,  as  demonstrated 
in  [23].  Using  results  from  the  PDS  literature,  existence  and 
uniqueness  of  solutions  to  the  GPAW  compensated  system 
can  thus  be  easily  established,  as  shown  in  Section  IV.  In 
Section  V,  equilibria  of  the  systems  are  characterized,  leading 
to  the  study  of  the  associated  region  of  attraction  (ROA). 

It  is  widely  accepted  as  a  rule  that  the  performance  of 
a  control  system  can  be  enhanced  by  trading  off  its  ro¬ 
bustness  [24,  Section  9.1].  As  such,  we  consider  an  anti¬ 
windup  scheme  to  be  valid  only  if  it  can  provide  performance 
enhancements  without  reducing  the  system’s  ROA.  The  first 
question  to  be  addressed  is  whether  the  GPAW  scheme  satisfy 
such  a  criterion,  and  is  shown  to  be  affirmative  in  Section  VI. 
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Numerical  results  further  illuminate  this  property  of  GPAW 
compensated  systems. 

In  Section  VII,  we  illustrate  some  qualitative  weaknesses 
of  some  results  in  the  anti-windup  literature,  and  propose  a 
new  paradigm  in  addressing  the  anti-windup  problem,  in  which 
results  relative  to  the  uncompensated  system  are  sought.  This 
is  the  case  for  the  main  result  of  this  report.  Proposition  4. 


II.  Preliminaries 

Let  the  system  to  be  controlled  be  described  by 

x  =  ax  +  bs&t(u),  (1) 

where  the  saturation  function  is  defined  by 

if  tx  R  tirnax , 

if  Umin  <C  U  <C  Umax, 
if  U  <  Umin  , 

and  x,  u  £  R  are  the  plant  state  and  control  input  respectively, 
a,  b,  Umin,  umax  G  R  are  constant  plant  parameters  with 
Umin, Umax  Satisfying  U-min  R  0  R  Umax •  Let  the  HOIIli HCI l 
controller  be 

Xc  =  CXc  +  dx , 

(2) 

u  =  exc, 

where  xc,u  £  R  are  the  controller  state  and  output  respec¬ 
tively,  x  £  R  is  the  measurement  of  the  plant  state,  and 
c,  d,  e  £  R  are  controller  gains  chosen  to  globally  stabilize 
the  unconstrained  system,  ie.  when  umax  =  — umin  =  oo. 

Remark  1:  It  is  important  that  the  output  equation  of  the 
nominal  controller,  namely  u  =  exc,  depends  only  on  the 
controller  state  xc  and  independent  of  measurement  x.  That 
is,  if  the  output  equation  is  u  =  exc  +  fx ,  then  we  require 
/  =  0.  This  property  ensures  that  full  controller  state-output 
consistency,  ie.  sat(xx)  =  u ,  can  be  maintained  at  “almost  all” 
times  (stated  more  precisely  as  Fact  1  below)  when  applying 
the  GPAW  scheme.  For  general  nominal  controllers,  this 
requirement  and  its  consequences  on  the  GPAW  compensated 
controller  are  detailed  in  [25],  together  with  remedies  when 
the  nominal  controller  does  not  have  the  required  structure.  □ 
A  simple  transformation  of  (2)  yields  the  equivalent  con¬ 
troller  realization 

u  =  cx  +  du ,  (3) 

with  c  :=  de,  d  :=  c.  Applying  the  GPAW  scheme  [1]  to  the 
preceding  transformed  nominal  controller  (3)  yields  the  GPAW 


sat(xx)  = 


compensated  controller  (see  Appendix  A) 

{0,  if  It  >  Umax,  CX  +  du  >  0, 

0,  if  U  <  Umin,  CX  +  du  <  0,  (4) 

cx  +  du,  otherwise, 

which  is  similar  to  the  “conditionally  freeze  integrator” 
method  [26].  This  is  expected  since  the  GPAW  scheme  can 
be  viewed  as  a  generalization  of  this  idea  to  MIMO  nonlinear 
controllers.  Observe  that  the  first  order  GPAW  compensated 
controller  is  independent  of  the  GPAW  tuning  parameter  I 
introduced  in  [1],  which  is  true  for  all  first  order  controllers. 
Furthermore,  inspection  of  (4)  reveals  the  following. 

Fact  1  (Controller  State-Output  Consistency):  If  for  some 
T  £  R,  the  control  signal  of  the  GPAW  compensated  con¬ 
troller  (4)  at  time  T  satisfies  urnln  <  u(T)  <  umax ,  then 
umin  <  u(t)  <  umax  holds  for  all  t  >  T.  □ 

That  is,  the  GPAW  compensated  controller  maintains  full  con¬ 
troller  state-output  consistency,  sat  (it)  =  u,  for  all  future  times 
once  it  has  been  achieved  for  any  time  instant.  In  particular,  if 
the  controller  state  is  initialized  such  that  sat(u(0))  =  u(0), 
then  sat (u(t))  =  u(t)  holds  for  all  t  >  0. 

Remark  2:  For  nonlinear  MIMO  controllers  whose  output 
equation  depends  only  on  the  controller  state,  the  same  result 
(state-output  consistency  of  GPAW  compensated  controller) 
holds  as  shown  in  [25,  Theorem  1].  □ 

The  nominal  constrained  closed-loop  system,  £n,  is  de¬ 
scribed  by  (1)  and  (3), 


x  =  ax  +  6sat(u), 
u  =  cx  +  du, 


while  the  GPAW  compensated  closed-loop  system,  £s,  is 
described  by  (1)  and  (4), 


x  =  ax  +  6  sat  (u), 


cx  +  du, 


if  U  >  Umax ,  CX  +  du  >  0, 
if  U  <  Umin ,  CX  +  du  <  0, 

otherwise. 


Each  of  these  systems  can  be  expressed  in  the  form  z  =  f(z) 
with  /:  R2  — »  R2.  The  representing  functions  (vector  fields) 
for  systems  £„  and  £g  will  be  denoted  by  fn  and  fg 
respectively.  The  following  will  be  assumed. 

Assumption  1:  The  controller  parameters  c,  d  satisfy 


a  T  d  0,  (5) 

ad  —  be  >  0,  (6) 
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and  be  ^  0.  □ 

The  characteristic  equation  of  the  unconstrained  system,  ie. 
S„  with  umax  =  —Umin  =  oo,  can  be  verified  to  be 

s2  —  (a  +  d)s  +  (ad  —  be)  =  0, 

so  that  Assumption  1  ensures  that  the  origin  is  a  globally 
exponentially  stable  equilibrium  point  for  the  nominal  uncon¬ 
strained  system.  The  condition  be  ^  0  ensures  that  c,  d  can 
be  chosen  to  satisfy  (5)  and  (6),  and  that  X„  is  a  feedback 
system. 

We  will  need  the  following  sets 


I\ 

=  {(x 

u) 

£ 

R2 

t xin  <  U  ^  rUjmax\ i 

l<+ 

=  {(* 

u) 

£ 

R2 

u 

> 

Umax  }  i 

I\- 

=  {(* 

u) 

£ 

R2 

u 

< 

^min  }  i 

dK+ 

=  {{x 

u) 

£ 

R2 

u 

= 

'Umax  }  i 

dK- 

=  {{.X 

u) 

£ 

R2 

u 

= 

Umin }  7 

dK+div 

=  {(* 

u) 

£ 

R2 

u 

> 

Umax  7  CX 

+ 

S2 

II 

=  0}, 

K-\-in 

=  {{x 

u) 

£ 

R2 

u 

> 

Umax  7 

+ 

du  <  0}, 

K+out 

=  {{.X 

u) 

£ 

R2 

u 

> 

Umax  7 

+ 

du  >  0}, 

dK—div 

=  {(* 

u) 

£ 

R2 

u 

< 

Umin  7 

+ 

II 

53 

=  0}, 

K—in 

=  {{.X 

u) 

£ 

R2 

u 

< 

Umini 

+ 

du  >  0}, 

K—out 

=  {{x 

u) 

£ 

R2 

u 
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Umin  7 

+ 
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R2 

u 

= 
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and  the  points 

z+  =  ( 

—  —7 1 

c  u,maxi 

Umax ) 

*-  =  (- 

d-u 

C 
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Umin)  ■ 

Fact  2:  The  vector  fields  and  fg  coincide  in 

K  U  K+in  U  K_in  U  d K+div  U  d K-div 

U  dK+in  U  dK-  in  U  {z+,  z-j. 

That  is,  they  coincide  in  R2  \  ( K+out  U  K-out  U  dK+out  U 

dI<_out).  □ 

Fact  3:  Any  solution  of  systems  Xn  or  Sg  can  pass  from 
K+  to  K  if  and  only  if  it  intersects  the  line  segment  d K+in, 
and  analogously  with  respect  to  K _  and  BK  □ 

Fact  4:  Any  solution  of  system  En  can  pass  from  K  to 
K+  if  and  only  if  it  intersects  the  line  segment  dK+out,  and 
analogously  with  respect  to  K-  and  <)K _ouf  .  □ 

III.  GPAW  Compensated  Closed  Loop  System  as  a 
Projected  Dynamical  System 

Two  of  the  most  fundamental  properties  required  for  a 
meaningful  study  of  dynamic  systems  is  the  existence  and 
uniqueness  of  their  solutions.  As  evident  from  the  definition  of 
the  GPAW  compensated  controller  (4),  the  vector  field  of  the 
GPAW  compensated  system,  fg,  is  in  general  discontinuous 
on  the  saturation  constraint  boundaries  dK+out  (C  dK+ ) 
and  dK-out  (C  dK-).  Classical  results  on  the  existence  and 
uniqueness  of  solutions  [7]— [10]  rely  on  Lipschitz  continuity 
of  the  governing  vector  fields,  and  hence  do  not  apply  to 
GPAW  compensated  systems.  While  results  in  [27]  can  be  used 
to  assert  such  properties,  we  will  use  results  from  the  projected 
dynamical  system  (PDS)  [19]— [22]  literature  to  assert  the 
existence  and  uniqueness  of  solutions  to  GPAW  compensated 
systems.  First,  we  show  here  that  the  GPAW  compensated 
system,  Sg,  is  in  fact  a  PDS. 

Observe  that  the  set  K  is  a  closed  convex  set  (in  fact,  a 
closed  convex  polyhedron).  The  interior  and  boundary  of  K 
are  K  and  dK  +  U  dK-  respectively.  Let  P :  R2  — +  K  be  the 
projection  operator  [19]  defined  for  all  y  £  R2  by 


These  sets  and  associated  vector  fields  are  illustrated  in  Fig.  1 
for  an  open  loop  unstable  plant,  and  in  Fig.  2  for  an  open  loop 
stable  plant. 

Observe  that  K+  =  K+in  U  K+div  U  K+out  and  3K+  = 
dK+in  U dK+out  U{z+},  with  analogous  counterparts  for  iv_ 
and  dK-.  Observe  further  that  on  dK+in  and  vector 

fields  of  systems  En  and  Sg  (/„  and  fg  respectively)  point  into 
K.  On  dK+out,  fn  points  into  K+  and  fg  points  into  dK+. 
On  dK-out ,  fn  points  into  K-  and  fg  points  into  dK-. 

By  inspection  of  the  vector  fields  fn  and  fg  from  their 
definitions ,  we  have  the  following. 


P(y)  =  arg min||y  -  z\\, 
zeK 


with  ||-||  as  the  Euclidean  norm.  It  can  be  seen  that  for  any 
(x,u)  €  R2,  P((x,u))  =  (x,sat(w)).  Next,  for  any  y  £  K, 
v  €  R2,  define  the  projection  of  vector  v  at  y  by  [19],  [20] 


n(y,  v)  =  lim 

d  J.0 


P(y  +  Sv)  -  y 

S 


Note  that  the  limit  is  one-sided  in  the  above  definition  [20]. 
With  fn  being  the  vector  field  of  E„,  written  explicitly  as 


fn(x,u) 


ax  +  bu 
ex  +  du 


W(x,  u)  £  K , 
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X 


x 


Fig.  1:  Closed  loop  vector  fields  ( fn ,  fg )  of  systems  E„,  Eg  and  the  unconstrained  system  (E„,  /„),  associated  with  an  open 
loop  unstable  system  (plant  and  controller  parameters:  a  =  1,  b  =  1,  c  =  —3,  d  =  —2,  —umin  =  umax  =  1).  Vector  fields  of 
systems  En,  Eg  and  E„  (/„,  fg ,  /„)  are  shown  on  the  left,  while  the  vector  field  differences  (/„  —  fu,  fg  —  /„)  are  shown 
on  the  right. 


£  £ 

Fig.  2:  Closed  loop  vector  fields  (/„,  fg)  of  systems  Era,  Eg  and  the  unconstrained  system  (E„,  fu )  associated  with  an  open 
loop  stable  system  (plant  and  controller  parameters:  a  =  —1,  b  =  1,  c  =  —1,  d  =  0.5,  —umin  =  umax  =  1)-  Vector  fields  of 
systems  En,  Es  and  Eu  (/„,  fg,  fu )  are  shown  on  the  left,  while  the  vector  field  differences  (fn  —  /„,  fg  —  /„)  are  shown 
on  the  right. 


we  have  the  following,  the  corollary  of  which  is  the  desired 
result. 


small  6  >  0,  we  have 

P{{x1u)  +  6fn(x,u)) 


Claim  1:  For  all  ( x,u )  £  K,  the  vector  field  fg  of  the 
GPAW  compensated  closed  loop  system  E g  satisfy 


x  +  <5(aa;  +  bu) 
sat(rt  +  S(cx  +  du)) 
x  +  5  {ax  +  bu) 
u  +  5(cx  +  du) 


fg{x,u)  =  u),  fn(x,  u)). 


Proof:  If  (x,  u )  G  K,  the  result  follows  from  [20, 
Lemma  2. 1  (i)]  and  Fact  2.  Next,  consider  a  boundary  point, 
( x ,  u)  £  dK+in  U  {.3-1-}.  On  this  segment,  we  have  u  =  umax 
and  cx  +  dumax  <  0  from  definition  of  the  set  dK+in  U  {z+j- 
Since  sat  {umax+SP)  =  umax+8/3  for  f3  <  0  and  a  sufficiently 


so  that 


■jr((x,u),fn(x,u))  =  lim 


P((x,  u)  +  5fn(x,  u))  -  (x,  u ) 


ax  +  bu 
cx  +  du 


=  fn{x,u)  =  f g  (x,  u)  , 


for  all  (x,  u)  £  dK+inU{z+},  where  the  final  equality  follows 
from  Fact  2. 
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Finally,  consider  a  boundary  point  (x,u)  £  dK+out.  On 
this  segment,  we  have  u  =  umax  and  cx  +  dumax  >  0  from 
the  definition  of  dK+out.  Since  sat(urnax  +  S/3 )  =  umax  for 
(3  >  0  and  a  sufficiently  small  S  >  0,  we  have 


P{{x,u )  +  Sfn(x,  u)) 


x  +  5  (ax  +  bu) 
sat(«  +  S(cx  +  du)) 

x  +  6  (ax  +  bu) 
u 


so  that 


((  w,  \ \  P((x,u)  +  Sfn(x,u))  -  (x,u) 

tt((x,u  ),fn(x,u))  =  lim - — - . 

<5J,0  0 


ax  +  bu 

0 


=  fg(x,u), 


for  all  ( x,u )  £  d K+out-  The  above  established  the  claim  for 
all  points  on  K  \  dK_ .  The  verification  on  the  boundary  OK  - 
is  similar  to  that  for  0K+.  ■ 

Corollary  1:  The  GPAW  compensated  system  £g  is  a  pro¬ 
jected  dynamical  system  [19]  governed  by 


Z  =  fg(z)  =  K(z,fn(z)), 

where  z  =  (x,  u). 

Corollary  1  will  be  used  in  the  next  section  to  assert  the 
existence  and  uniqueness  of  solutions  to  system  £g.  See  [19]— 
[21]  for  a  detailed  development  of  PDS,  and  [23]  for  known 
relations  to  other  system  descriptions. 


IV.  Existence  and  Uniqueness  of  Solutions 


Here,  we  assert  the  existence  and  uniqueness  of  solutions  to 
both  the  nominal  constrained  system  and  GPAW  compensated 
system. 

Claim  2:  The  nominal  system  £„  has  a  unique  solution  for 
all  initial  conditions  (x(to) ,  u(to))  £  R2  and  all  t  >  t o. 

Proof:  For  all  z  :=  (x,u)  £  R2,  the  vector  field  fn  can 
be  written  as 


fn(z)  =  Az  + 


b 

0 


sat(u), 


where  A  = 


a 

c 


0 

d 


It  can  be  verified  [8,  Example  3.2,  pp.  91  -  92]  that  the 
saturation  function  is  globally  Lipschitz  with  unity  Lipschitz 
constant,  ie.  |sat(a)—  sat(/3)|  <  \a—j3\.  Then  global  Lipschitz 
continuity  of  fn  for  all  f  >  <o  follows  from 


II  fn(z)  -  fn(z)  II  =  \\A(z  -z)  +  [6, 0]T(sat(u)  —  sat  (it))  ||, 

<  \\A(z  -  5)||  +  ||[6,0]T(sat(u)  -  sat(u))||, 
=  ||  A(z  —  5)||  +  |6||sat(u)  —  sat(u)|, 


<||A||||^-5||  +  |f,||U-n|, 

<(||A||  +  |6|)P-5||t  (7) 

for  all  z  :=  ( x,u )  £  R2,  5  :=  (x,  u)  £  R2.  By  [8, 

Theorem  3.2,  pp.  93],  £„  has  a  unique  solution  defined  for 
all  t  >  to,  for  all  (x(to),u(to))  £  R2-  ■ 

We  will  need  the  following  assumption  used  to  assert  the 
existence  and  uniqueness  of  solutions  to  PDS. 

Assumption  2  (  [19,  Assumption  1]):  There  exists  B  <  oo 
such  that  the  vector  field  /„ :  Rfc  — >  Rfc  satisfies  the  following 
conditions 

||/n(«)||<B(l+|H|),  Vz  £  K,  (8) 

ifn(z)  -  fn(z),z-  5)  <  B\\z-  5||2,  Mz,z£K,  (9) 

where  (x,  y)  denotes  the  dot  product  of  x  and  y.  □ 

The  following  result  is  stated  without  proof  in  the  remark 
following  [19,  Assumption  1], 

Claim  3:  If  fn  is  Lipschitz  in  K  C  Rfe,  then  Assumption  2 
holds. 

Proof:  Since  fn  is  Lipschitz  in  K,  there  exists  an  L  <  oo 
such  that  ||  fn(z)  —  /n(5)||  <  L\\z  —  5||  for  all  z,z  £  K.  To 
show  that  (8)  holds,  observe  that 

\\fn(z)\\  =  ||  fn(z)  -  fn(z)  +  /„(5)  ||, 

<  II  fn(z)  -  fn(z)  ||  +  ||/n(5)||, 

<  L\\z-z\\+  \\fn (5)  || , 

<L|H|+L||5||  +  ||/n(5)||, 

for  all  z,z  £  K.  Fix  any  5  £  K  and  define  a  :=  L||5||  + 
||/n(5)||  (<  oo)  and  B  :=  max{L,a}  (<  oo),  so  that  the 
preceding  inequality  becomes 

\\fn(z)\\<L\\z\\+a<B(l  +  \\z\\),  Mz£K, 

which  proves  (8). 

By  the  Cauchy-Schwarz  inequality,  we  have 

ifn(z)  -  fn(z),Z-  5)  <  ||/n(z)  -  /„(5)  ||  \[Z  -  5|| , 

<  L\\z  —  5||2  <  B\\z  —  5||2, 

for  all  z,  5  £  K,  which  proves  (9).  ■ 

Remark  3:  Both  Assumption  2  and  Claim  3  are  stated  for 
general  vector  fields  fn  and  regions  K  in  Rfe,  but  will  be 
specialized  to  vector  fields  and  regions  in  R2  in  the  sequel.  □ 
The  following  is  the  main  result  of  this  section. 
Proposition  1:  The  GPAW  compensated  system  Eg  has  a 
unique  solution  for  all  initial  conditions  (x(to),  u(to))  £  R2 
and  all  t  >  to. 
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Proof:  Since  fn :  R2  — >  R2  is  globally  Lipschitz  (see  (7)), 
it  is  Lipschitz  in  K  C  R2,  so  that  Assumption  2  holds  due  to 
Claim  3.  Since  E9  is  a  PDS  (see  Corollary  1  and  [19,  Equa¬ 
tion  (7)]),  it  follows  from  Assumption  2  and  [19,  Theorem  2] 
that  Eg  has  a  unique  solution  defined  for  all  t  >  to  whenever 
the  initial  condition  satisfies  (x(to),u(to))  £  K  (also  recall 
Fact  1).  To  assert  the  existence  and  uniqueness  of  solutions 
for  all  initial  conditions  (x(to),u(to))  £  R2,  it  is  sufficient  to 
establish  this  outside  K,  and  if  the  solution  enters  K,  there 
will  be  a  unique  continuation  in  K  for  all  future  times  from 
this  result. 

Consider  the  region  K+  =  K+in  U  K+out  U  dK+diV.  The 
proof  for  the  region  K_  is  similar.  For  any  Z\ .  z2  £  K+, 
there  are  three  possible  cases.  Firstly,  in  the  region  K+out  := 
K+0ut  U  dK+ciiv,  we  get  from  the  definition  of  fg  and  K+out, 
that  fg(z)  =  fg(x,u )  =  (ax  +  bumax,  0).  Clearly,  for  any 
Zi,z2  £  K+out,  we  have  ||/9(zi)  -  fg(z2) ||  <  Lout\\zi  -  z2\\ 
where  Lout  =  |a|  <  oo.  Secondly,  from  Fact  2,  fg  and 
fn  coincide  in  I<+in  :=  K+in  U  dK+div,  so  that  fg  is 
also  Lipschitz  in  K+in.  For  any  2:1,22  £  K+in,  we  have 
\\fg(zi)-fg(z2)\\  <  Lm\\zl-z2\\  where  Lin  =  ||A||  +  |b|  <  00 
(see  (7)).  The  last  case  corresponds  to  Z\  and  z2  being  in 
different  regions,  K+in  and  I\+out.  Without  loss  of  generality, 
let  z-\  £  K+in  and  z2  £  K+out.  The  straight  line  in  R2 
connecting  Z\  and  z2  then  contains  a  point  z  £  dK+div  with 
the  property  that  z  £  K+in  n  K+out,  ||^i  —  5||  <  ||zi  -  z2||, 
and  |[z2  —  z\\  <  \\zi  —  z2||-  Then  we  have 

ll/5(2i)  -  fg(z2) ||  =  ||/g(2i)  -  / 5 (2)  +  / g (2)  -  fg(z2) ||, 

<  ll/5(2i)  -  fg(z) ||  +  11/5(22)  -  fg(z) ||, 

<  Lin\\zi  -  z\\  +  Lout\\z2  -  z ||, 

<  (Lin  +  Lout)\\Zi  —  22||, 

which,  together  with  the  first  two  cases,  shows  that  fg  is  Lips¬ 
chitz  in  K+.  By  [9,  Theorem  3.1,  pp.  18  -  19],  S9  has  a  unique 
solution  contained  in  K+  whenever  (x(tf),u(to))  £  K+.  If 
the  solution  stays  in  K+  for  all  t  >  0,  the  claim  holds. 
Otherwise,  by  [9,  Theorem  2.1,  pp.  17],  the  solution  can  be 
continued  to  the  boundary  of  K+,  dK+  C  K.  In  this  case,  the 
first  part  of  the  proof  shows  that  there  is  a  unique  continuation 
in  K  for  all  t  >  0.  ■ 

Remark  4:  Care  is  due  when  interpreting  the  existence  and 
uniqueness  results  of  Proposition  1.  Let  <j>n(t,  Zq)  be  the  unique 
solution  of  system  E„  starting  from  Zq  £  R2  at  time  t  =  0. 
For  system  E„,  existence  and  uniqueness  of  solution  implies 


that  no  two  different  paths  intersect  [9,  pp.  38],  and 

4>n(-t,<i>n(t,Zo))  =  Z0,  Vf  G  R,V20  G  R2- 

That  is,  proceeding  forwards  and  then  backwards  in  time  by 
the  same  amount,  the  solution  always  reaches  its  starting  point. 
This  is  not  true  for  system  Es  whenever  the  solution  intersects 
8 K+out  or  OK .  Inspection  of  the  vector  field  fg  reveals 
that  in  this  case,  all  forward  solutions  either  stay  in  dK+out 
or  dK_out  for  all  future  times,  or  they  eventually  reach  the 
points  z+  or  Z-.  Furthermore,  traversing  backwards  in  time 
from  any  point  of  OK +out  or  d K_out,  the  solution  stays  on 
these  segments  indefinitely.  That  is,  dK+out  and  <)K _out  are 
negative  invariant  sets  [9,  pp.  47]  for  system  Eg.  If  a  forward 
solution  of  Eg  intersects  dI\+out  or  dK_out  starting  from 
some  interior  point  Zq  £  K,  then  traversing  backwards  in 
time,  the  solution  will  never  reach  zq. 

Existence  and  uniqueness  of  solutions  of  system  Eg  means 
that  if  two  distinct  trajectories,  <j)g(t,  Z\),  <j>g(t,  z2),  intersect  at 
some  time,  then  they  will  be  identical  for  all  future  times,  ie. 
if  4>g(Ti,Zi)  =  <f>g(T2,z2)  for  some  Ti,T2  £  R,  then  fg(t  + 
Ti,  21)  =  <j)g(t  +  T2,  z2)  for  all  t  >  0.  Specifically,  they  can 
never  diverge  into  two  distinct  trajectories.  □ 

V.  Equilibrium  Points 

In  this  section,  we  characterize  all  equilibria  of  systems  En 
and  Eg.  Of  primary  importance  is  the  origin,  stated  below. 

Claim  4:  The  origin  zeq 0  :=  (0,  0)  is  the  only  equilibrium 
point  of  systems  En  and  Eg  in  K,  and  it  must  be  either  a 
stable  node  or  stable  focus. 

Proof:  In  K,  the  vector  fields  fn  and  fg  coincide  (see 
Fact  2),  and  can  be  written  as  fn(z)  =  fg(z )  =  Az,  where 
A  =  [  “  bd  ] .  It  is  clear  that  the  origin  is  an  equilibrium  point 
due  to  fn(zeqo)  =  fg(zeqo)  =  Azeq0  =  0  G  R2.  From  (6), 
the  matrix  A  is  invertible  and  hence,  zeq o  must  be  the  only 
equilibrium  point  in  K .  Due  to  Assumption  1,  zeq o  must  be 
either  a  stable  node  or  a  stable  focus  [7,  Section  2.2.1,  pp.  32 
-  35].  ■ 

Additional  equilibria  of  the  nominal  system  En  are  character¬ 
ized  below. 

Claim  5:  Apart  from  the  origin  zeq o,  the  nominal  system 
E„  admits  two  additional  isolated  equilibrium  points  defined 
by 

Zeq+  (  ^tJjniax,  d+jjtlrnax')  ,  Zeq—  (  fflnnin,  , 

only  when 

(i)  the  open  loop  system  is  unstable  (a  >  0),  or 
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(ii)  the  open  loop  system  is  strictly  stable  (a  <  0)  and 
controller  parameter  satisfies  d  £  (0,  —a). 

Moreover,  if  zeq+  and  are  equilibria  of  E„,  they  are 

saddle  points  and  lie  strictly  in  K+  and  /\  _  respectively,  ie. 

zeq+ ,  zeq_  (0K+  U  OK_ ) . 

Remark  5:  When  zeq+  and  zf:q-  are  equilibria  of  E„,  it 
can  be  verified  that  they  must  lie  in  dK+rjlv  and  dK_div 
respectively.  □ 

Proof:  All  equilibria  of  E  „  are  determined  from  the 
condition  fn(z)  =  0.  It  can  be  verified  from  the  conditions 
ax  +  bsat(u)  =  0  (from  fn(z )  =  0)  and  be  0  of  As¬ 
sumption  1,  that  whenever  the  open  loop  system  is  marginally 
stable,  ie.  a  =  0,  there  can  be  no  equilibria  apart  from  zeq o. 
Similarly,  whenever  d  =  0,  the  conditions  cx  +  du  =  0  (from 
fn{z)  =  0),  be  ^  0,  and  ax  +  &sat(rt)  =  0  implies  that 
there  can  be  no  additional  equilibria  apart  from  zeq o.  Together, 
this  means  ad  ^  0,  and  zeq+  and  zeq-  are  well-defined.  A 
simple  computation  shows  that  apart  from  zeq o,  the  additional 
equilibria  are  z,:q+  and  zei provided  zeq+  £  K+UdK+  and 
ze £  K_  U  <9  AT _.  These  hold  if  and  only  if  ad  ^  0  and 
>  1.  From  (6),  ^  >  1  holds  if  and  only  if  ad  <  0,  which 
results  in  the  strict  condition  h'i  >  1.  Therefore,  if  zeq+  and 
zeq.  are  indeed  equilibria  of  En,  they  must  lie  in  K+  and 
A'_  respectively,  ie.  they  cannot  lie  on  OK  +  or  0K_.  If  the 
open  loop  system  is  unstable,  ie.  a  >  0,  then  from  (5),  we 
must  have  d  <  —a  <  0,  which  implies  ad  <  0  and  E„  indeed 
has  zet J+  and  zeq-  as  equilibria.  If  the  open  loop  system  is 
strictly  stable,  ie.  a  <  0,  then  ad  <  0  and  (5)  hold  if  and  only 
if  d  £  (0,— a).  It  remains  to  show  that  zeq+  and  zeq _  must 
be  saddle  points  [7,  Section  2.2.1,  pp.  32  -  35]  whenever  they 
are  equilibria  of  E„. 

The  Jacobian  of  /„  at  the  isolated  equilibrium  points  zeq+  £ 
K+  and  zeq-  £  AT _  are  identical  and  given  by 


9fn 

dz 


( zeq+ ) 


dJ^(  z  )-A 

dz  {Zeq->  ~  A 


a  0 
c  d 


Since  its  eigenvalues  are  a,  d,  and  ad  <  0,  the  equilibria  zeq+ 
and  zeq_  must  be  saddle  points.  ■ 

The  following  characterizes  additional  equilibria  of  the 
GPAW  compensated  system  Eg. 

Claim  6:  Apart  from  the  origin  zeq o,  the  GPAW  compen¬ 
sated  system  Eg  admits  additional  equilibria  only  when 
(i)  the  open  loop  system  is  unstable  (a  >  0).  Additional 
equilibria  are  all  points  in  the  two  connected  sets  defined 
by 


Zeq+  =  {(x,u)  €  R2 


X  =  ~T.U 


maxi 


tlmax  —  11  E  — d^lmax }  C  (A_|_  U  (9A_|_), 

Zeq_  =  |  (x,  if)  £  R.  |  X  — 

E  a  E  timin'^  C  (A_  U  (IA_). 

(ii)  the  open  loop  system  is  strictly  stable  (a  <  0)  and 
controller  parameter  satisfies  d  £  (0,—a).  Additional 
equilibria  are  all  points  in  the  two  connected  sets  defined 
by 

Zeq_i_  =  |(x,w)  £  IR.  |  x  =  ~Timaa;, 

tt  K  ^ ttmax }  C  A_|_, 

Zeq—  —  £  R.  |  X  —  —Umim 

tt  E  ~^d'amin}  C  A_. 


Remark  6:  Observe  that  whenever  E„  has  additional  equi¬ 
libria  other  than  zeq o,  so  does  E9.  The  converse  statement 
is  also  easily  verified.  Moreover,  observe  that  zeq+  and  z,.q_ 
belongs  to,  and  lies  on  the  endpoints  of  the  sets  Zeq+  and 
Zeq_  respectively.  □ 

Proof:  All  equilibria  of  Eg  are  determined  from  the 
condition  fg(z)  =  0.  It  can  be  verified  from  the  conditions 
ax  +  bsat(u)  =  0  (from  fg{z)  =  0)  and  be  0  of  As¬ 
sumption  1,  that  whenever  the  open  loop  system  is  marginally 
stable,  ie.  a  =  0,  there  can  be  no  equilibria  apart  from  zeqo- 
Computation  shows  that  apart  from  zeq o,  all  points  in  the  sets 

Zeq+  =  {(x,  Xl)  £  R*  |  X  = 

a  E  tlmax^du  -  yy'Umax}  , 

Zeq—  —  ^(x,Zt)  £  R  |  X 

a  E  tlmin ,  dll  E  yy  tlmin  }  , 

are  also  equilibria  of  Eg,  provided  these  sets  are  non-empty. 
Considering  the  conditions  u  >  umax  and  du  >  y^umax  (and 
their  analogous  counterparts),  these  sets  are  non-empty  if  and 
only  if  (a)  d  >  0,  (b)  d  =  0  and  ^  E  0,  or  (c)  d  <  0  and 
%  >  1. 

Consider  case  (a).  From  (5),  this  case  (d  >  0)  is  possible 
only  when  a  <  0,  ie.  the  open  loop  system  is  strictly  stable. 
To  satisfy  (5)  and  d  >  0,  we  must  restrict  d  £  (0,—a).  Hence 
ad  <  0  and  (6)  implies  ^  >  1.  The  above  sets  Zeq+  and 
Zeq_  then  simplifies  to  those  stated  in  the  claim  for  case  (ii). 

Now  consider  case  (b).  With  d  =  0,  conditions  (5)  and  (6) 
reduces  to  a  <  0  and  be  <  0  respectively,  which  implies 
^  >  0.  Therefore,  Assumption  1  ensures  that  this  case  (in 
particular,  ^  E  0)  cannot  occur. 

Finally,  consider  case  (c).  From  (6),  this  case  (in  particular, 
^2  >  1)  is  possible  only  when  ad  <  0,  which  in  turn  implies 
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||  >  1  holds  with  strict  inequality.  The  condition  ad  <  0  for 
this  case  (in  particular,  d  <  0)  implies  a  >  0,  ie.  the  open 
loop  system  is  unstable.  It  is  easily  verified  that  the  above 
sets  Zeq+  and  Zeq  simplifies  to  those  stated  in  the  claim  for 
case  (i).  ■ 

Remark  7:  Observe  that  the  presence  of  additional  equi¬ 
libria  precludes  the  possibility  of  the  origin  being  a  globally 
asymptotically  stable  equilibrium  point  for  both  systems  En 
and  Eg.  However,  note  that  a,  d  (and  6,  c)  are  given  fixed 
parameters  in  the  anti-windup  context.  □ 

In  summary,  zeqo  is  an  isolated  stable  equilibrium  point  of 
systems  En  and  Eg  for  all  a,  b,  c,  d  £  R  satisfying  Assump¬ 
tion  1,  and  it  is  the  only  equilibrium  point  in  K.  When  the 
open  loop  system  is  marginally  stable,  or  strictly  stable  with 
d  <  0,  there  cannot  be  additional  equilibria.  When  the  open 
loop  system  is  unstable,  or  strictly  stable  with  d  £  (0,  —a), 
S„  has  two  more  isolated  equilibrium  points  zeq+  and  ze 9_ 
which  are  saddle  points,  and  Eg  has  a  continuum  of  equilibria 
Zeq+  and  Zf.q — 

VI.  Region  of  Attraction 

The  purpose  of  anti-windup  schemes  is  to  provide  perfor¬ 
mance  improvements  only  in  the  presence  of  control  satura¬ 
tion.  It  is  widely  accepted  as  a  rule  that  the  performance  of 
a  control  system  can  be  enhanced  by  trading  off  its  robust¬ 
ness  [24,  Section  9.1],  To  distinguish  anti-windup  schemes 
from  conventional  control  methods,  we  consider  an  anti¬ 
windup  scheme  to  be  valid  only  if  it  can  provide  performance 
enhancements  without  reducing  the  system’s  region  of  attrac¬ 
tion  (ROA).  We  show  in  this  section  that  GPAW  compensation 
can  only  maintain/enlarge  the  ROA  of  the  nominal  system  E„. 
In  other  words,  the  ROA  of  system  E„  is  contained  within  the 
ROA  of  Eg. 

While  there  may  exist  multiple  equilibria  for  systems  E„ 
and  Eg,  we  are  primarily  interested  in  the  ROA  of  the  equilib¬ 
rium  point  at  the  origin,  zeq(l.  A  distinguishing  feature  is  that 
the  results  herein  refers  to  the  exact  ROA  in  contrast  to  ROA 
estimates  that  is  found  in  a  significant  portion  of  the  literature 
on  anti-windup  compensation.  For  clarity  of  presentation,  we 
present  the  result  in  two  parts,  where  the  ROA  containment 
is  shown  for  the  unsaturated  region  K  and  saturated  region 
R2  \  K  separately.  Some  numerical  examples  will  illustrate 
typical  ROAs  and  show  that  the  said  ROA  containment  can 
hold  strictly  for  some  systems.  In  the  sequel,  we  will  state  and 
prove  results  only  for  one  side  of  the  state  space,  namely  with 
respect  to  I\+  U  dK+.  The  analogous  results  with  respect  to 


A'_  LJ  dK_  can  be  readily  extended,  and  will  not  be  expressly 
stated. 

Let  (f)n(t.  Zq)  and  <j)g(t,Zo )  be  the  unique  solutions  of 
systems  E„  and  Eg  respectively,  both  starting  at  initial  state 
zq  at  time  t  =  0.  The  ROA  of  the  origin  ze qo  for  systems  E„ 
and  Eg  are  then  defined  by  [8,  pp.  314] 

Rn  =  {z  £  R2  |  4>n(t,  z)  — >  zeq0  as  t  ->  oo}, 

Rg  =  {z  £  K2  |  fg(t,  Z)  ->  2e  g0  SS  t  OO }  , 

respectively.  We  recall  the  notion  of  transverse  sections  and 
w  limit  sets. 

Definition  1  (  [7,  pp.  46]):  A  transverse  section  o  to  a 
vector  field  /:  R2  — »  R2  is  a  continuous,  connected  arc  in 
R2  such  that  the  dot  product  of  the  unit  normal  to  er  and  /  is 
not  zero  and  does  not  change  sign  oil  a.  □ 

In  other  words,  the  vector  field  has  no  equilibrium  points 
on  a  and  is  never  tangent  to  er  [7,  pp.  46],  It  is  clear 
from  the  definition  of  dK+in  and  dK_in  that  both  of  these 
line  segments  are  in  fact  transverse  sections  of  fn  and  fg. 
Moreover,  ()K+out  and  dK_out  are  also  transverse  sections 

of  f„. 

Definition  2  (  [7,  Definition  2.11,  pp.  44]):  A  point  z  £ 
R2  is  said  to  be  an  lo  limit  point  of  a  trajectory  <p(t,  zq)  if 
there  exists  a  sequence  of  times  tn,n  £  {1,2,  ...,oo}  such 
that  tn  f  oo  as  n  — >  oo  for  which  lim,,-^  <j)(tn,  zo)  =  z.  The 
set  of  all  oj  limit  points  of  a  trajectory  is  called  the  u>  limit  set 
of  the  trajectory.  □ 

For  convenience,  let  the  straight  line  connecting  two  points 
a,/J  €  R2  be  denoted  by  (=  l(/3,a)),  and  defined  by 

l(a,0)  =  {z  £  R2  \z  =  0a+{l-d)/3,\/d£  (0,1)}. 

Observe  that  l(a,/3)  does  not  contain  the  endpoints  a,  (3, 
except  for  the  degenerate  case  of  identical  endpoints,  in  which 
case,  l(a,a)  =  {q-}.  Next,  the  ROA  containment  in  the 
unsaturated  and  saturated  regions  are  shown  separately,  which 
combines  to  yield  the  desired  result. 

A.  ROA  Containment  in  Unsaturated  Region 

What  follows  is  a  series  of  intermediate  claims  to  arrive 
at  the  main  result  of  this  subsection.  Proposition  2.  Let  the 
straight  lines  connecting  the  origin  to  the  points  z+  and 
be 

(T+ =  l(zeqo,z+)0{z+}1  (T-  =  l(zeq0,  Z-)  U  (10) 

respectively.  Consider  a  point  zq  £  dK+in  with  the  property 
that  Zq  £  Rn  and  <pn(t,zo)  K+  for  all  t  >  0.  In  other 
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Fig.  3:  Closed  path  77(20)  encloses  region  D(zq)  C  AT  U  A'_. 
A  case  where  the  solution  enters  K_  and  also  intersects  <r+ 
is  shown  on  the  left,  while  a  case  where  the  solution  never 
enters  A'_  and  never  intersects  er+  is  shown  on  the  right. 


words,  Zo  is  in  the  ROA  of  system  E„  and  its  solution  stays 
in  KUK_  for  all  t  >  0.  As  a  consequence  of  Fact  4,  <j)n(t,  zo) 
can  never  intersect  dK+out  for  all  t  >  0.  Let 

tint  =  inf{t  G  (0,  00)  I  4>n(t ,  Zo)  G  cr+}. 

That  is,  tint  is  the  first  time  instant  that  the  solution  starting 
from  zo  at  t  =  0  intersects  er+,  or  00  if  it  does  not  intersect 
cr+.  If  tint  <  00,  the  path 

Vint(zo)  =  {z  G  K2  I  2  =  (j>n(t,Z0),Vt  G  [0 ,tint)} 

LI  l(fn(,tint,  ~o),  2Z+)  U  {2+}  U  l(,Zo,  2+), 

is  well  defined.  Otherwise,  the  path 

Vo(zo)  =  {2  G  I2  |  z  =  <pn(t,z0),Vt  >  0} 

U  {zeq 0}  U  cr+  U  l(z0,  z+), 

is  well  defined.  Now,  define  the  path  77(20)  G  R2  by 

I  t]int(zo),  if  tint  CX), 


Proof:  Let 

l(,4*n(fint  3  ^-o)  ,  ~+)  U  {2+},  if  tint  ^  OO, 

<j+ ,  otherwise. 

We  first  show  that  cr+  is  a  transverse  section  to  /„,  and  that  /„ 
always  points  into  D(zq)  on  <r+.  Let  a  G  {—1,  +1}  be  chosen 
such  that  (afz+,z0~z+)  >  0,  where  Tz+  =  ( umax ,  iumax) 
is  orthogonal  to  z+.  Then  oT |®tjr  is  the  unit  normal  of  <5+  that 
points  into  D(zq)-  Hence  cr+  is  a  transverse  section  to  fn,  and 
fn  points  into  D(zo)  on  d+  if  and  only  if  ( aTz+ ,  fn(z ))  >  0 
holds  with  strict  inequality  for  all  z  G  a+. 

Since  Zq  G  8K+in,  we  have  from  the  definition  of  8K+in 
that  Zq  =  (iCo,  Umax )  for  some  xq  that  satisfies  cxo+dumax  < 
0.  Then  20-2+  =  {x0+^umax,  0).  Due  to  cx0  +  dumax  <  0, 
the  condition 

(qT 2_)_,  Zq  2+)  —  OC  {umaxi  ~^Umax)  ,  (^0  T  fUmax,  0)  }  7 

“  ^Umax(.CtC 0  T  dumax)  >  0, 

can  hold  only  if  a  =  —  sgn(c).  From  the  definition  of  cr+, 
any  2  G  <5+  has  the  form  2  =  {—9dumax,9umax)  for  some 
9  G  (0, 1],  so  that  fn (2)  =  ((6  -  °f)9umax,  0)  on  <5+.  Using 
the  definition  of  fn  on  <r+,  we  have 


(olT Z- 1_ ,  fn  (-2^)  )  —  Q.  ( Umax  i  ~  ^ 


maxi  cu"max )  •>  ((^  c  )^^raa:r  5  0)  }  ■> 

=  —  sgn(c)  ( b  -  f )  9u2max  =  ^ 9u2max. 


V(zo)  =  \ 

[Vo(z0), 

which  can  be  verified  to  be  closed  and  connected.  Let  the 
open,  bounded  region  enclosed  by  77(20)  be  D(zq),  and  its 
closure  be  D(zq).  The  region  D(zq)  is  illustrated  in  Fig.  3. 

The  following  result  states  that  D(zq)  is  a  positive  invariant 
set  [9,  pp.  47],  and  it  must  contain  the  origin  zeq 0. 

Claim  7:  If  there  exists  a  point  20  G  8K+in  such  that  20  G 
Rn  and  </>„(£,  zq)  G  K  U  AT_  for  all  t  >  0,  then  D{zf)  C 
AT  U  I\-  is  a  positive  invariant  set  for  system  £n,  and  it  must 
contain  zeq0,  ie.  2ego  G  D(z0). 

Remark  8:  The  claim  states  specifically  that  under  the 
assumptions,  it  is  not  possible  for  <pn(t,zo)  to  intersect  cr+ 
without  having  77(20)  enclose  2e9o,  a  case  not  illustrated  in 
Fig.  3.  □ 


Since  9  G  (0, 1]  for  any  2  G  <f+,  we  have  from  (6)  that 
(aTzjrl  fn(z))  >  0,  which  shows  that  cr+  is  a  transverse 
section  to  /„  and  that  fn  always  points  into  D(zq)  on  er+. 

It  is  clear  that  1(zq,z+)  C  dK+in  is  also  a  transverse  section 
to  fn,  and  that  fn  always  points  into  D(zq)  011/(20,  2+).  Both 
of  these  results  show  that  any  solution  originating  in  D(zo) 
cannot  exit  D(zq)  through  the  line  segments  cr+  or  1(20,2+). 
Furthermore,  since  the  solution  is  unique  and  no  two  different 
paths  can  intersect  [9,  pp.  38],  the  region  D(zq)  enclosed  by 
77(20)  must  be  a  positive  invariant  set  [9,  pp.  47]  for  system 
£„.  The  assumption  0n(f,  20)  G  A'U  AT_  for  all  t  >  0  implies 
77(20)  C  K  U  AT_.  Hence  we  have  D(zo)  C  K  U  AT_. 

Finally,  from  the  assumption  20  G  Rn,  we  have  </>„(£,  20)  — > 
zeq 0  as  t  — >  00.  Since  D(zq)  is  a  positive  invariant  set  and 
20  G  -£>(20),  we  have  fn(t,zo)  G  D(zq)  for  all  t  >  0.  The 
conclusion  zeq0  G  D(zq)  then  follows  from  the  fact  that  D(zq) 
is  closed  and  hence  contains  all  its  limit  points.  ■ 

Claim  8:  If  there  exists  a  point  20  G  8K+in  such  that  20  G 
Rn  and  z0)  G  K  for  all  t  >  0,  then  all  points  in  D{zf)  C 
AT  also  lie  in  the  ROA  of  system  £n,  ie.  D(zq)  C  Rn . 
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Remark  9:  Specifically,  the  conclusion  implies  G 

D(z0)  C  Rn.  □ 

Proof:  Since  K  C  (K  UK-),  the  hypotheses  of  Claim  7 
are  satisfied.  Claim  7  then  shows  that  D(zq)  is  a  positive 
invariant  set.  The  condition  (j>n(t,Zo)  £  K  for  all  t  >  0 
implies  D(zq)  C  K.  It  was  shown  in  [28,  Section  6.2,  pp.  353 
-  363],  [9,  Theorem  1.3,  pp.  55]  that  for  planar  dynamic 
systems  with  only  a  countable  number  of  equilibria  and  with 
unique  solutions,  the  u>  limit  set  of  any  trajectory  contained 
in  any  bounded  region  can  only  be  of  three  types:  equilibrium 
points,  closed  orbits,  or  heteroclinic/homoclinic  orbits  [29, 
pp.  45],  which  are  unions  of  saddle  points  and  the  trajectories 
connecting  them.  It  follows  from  Claims  4  and  5  that  the 
origin  zeq o  is  the  only  equilibrium  point  of  E„  in  K,  which 
must  be  a  stable  node  or  stable  focus.  Hence  the  to  limit 
set  of  any  trajectory  contained  in  D(zf)  C  K  cannot  be 
heteroclinic/homoclinic  orbits.  By  Bendixson’s  Criterion  [8, 
Lemma  2.2,  pp.  67]  and  (5),  region  D(zq)  contains  no  closed 
orbits.  As  a  result,  the  to  limit  sets  must  consist  of  equilibrium 
points  only,  and  it  must  be  zeq{)  since  it  is  the  only  equilibrium 
point  in  K.  The  conclusion  follows  by  observing  that  D(zq)  is 
a  positive  invariant  set,  and  any  trajectory  starting  in  it  must 
converge  to  the  to  limit  set  {zeq o}  due  to  [8,  Lemma  4.1, 
pp.  127],  ■ 

The  points  z+  £  0K_  and  5.  £  OK  _ ,  defined  by 

Z--\-  • —  (  ^Umax ,  Umax)  ,  Z—  • —  (  y Urnin •  Urnin )  7 

and  the  line  segments 

£+  ==  Kz+,  z+)  C  dK+,  £_  :=  Z(z_,z_)  C  OK... 

will  be  needed  in  the  subsequent  development. 

Claim  9:  If  the  open  loop  system  is  stable  or  marginally 
stable,  ie.  a  £  0,  then  fg  points  towards  z+  on  dK+out,  ie. 
fg(z)  =  a(z+  —  z)  for  some  a  =  a(z)  >  0  and  for  all 
z  £  dK+out-  If  the  open  loop  system  is  unstable,  ie.  a  >  0, 
then  fg  points  towards  z+  on  £+,  fg(z+)  =  0,  and  fg  points 
away  from  z+  on  dK+out  \  (£+  U  {5+}). 

Proof:  From  the  definition  of  dK+out,  any  z  £  dK+out 
has  the  form  2  =  ( Xo,umax )  for  some  Xq  satisfying  cxq  + 
dumax  >  0.  For  any  z  £  dK+out,  we  have  fg(z)  =  (ax0  + 
bumax 7,0)  and  z+  -  z  =  (~(x0  +  +umax),  0)  where  z  = 
(x0 ,umax)  and  cx0  +  dumax  >  0.  The  condition  fg(z)  = 
a(z+  —  z)  is  clearly  equivalent  to  ax o  +  bumax  =  ~y:(cx o  + 
dumax )■  Since  cxq  +  dumax  >  0,  it  follows  that  fg(z)  = 


a(z+  —  z)  can  hold  with  a  >  0  if  and  only  if 

c(ax0  +  bumax )  <  0.  (11) 

If  a  =  0,  (6)  reduces  to  be  <  0  and  (11)  follows.  If  a  <  0,  we 
have  from  (6)  and  cx o  +  dumax  >  0  that 

c(ax0  +  bumax)  <  dcx0  +  adumax  =  a(c x0  +  du-max )  <  0, 

and  (11)  holds.  This  proves  the  first  statement  of  the  claim. 

Finally,  consider  the  case  a  >  0.  Then  (11)  is  equivalent 
to  cx o  <  -^«raoj,  and  cxq  +  dumax  >  0  is  equivalent  to 
cxq  >  — dumax ■  Hence  fg(z)  points  towards  z+  on  some 
z  =  ( Xo,umax )  £  dK+out  if  and  only  if  x0  satisfies 

dumax  <C  CX o  <  +  Umax  •  (12) 

It  can  be  verified  that  — dumax  <  ——umax  due  to  (6).  The 
above  condition  (12)  can  be  decomposed  and  rewritten  as 

y-Umax  £  Xq  £  ^Umaxi  if  C  >  0, 

-^Umax  <  Xo  <  - +  umax ,  otherwise, 

so  that  (12)  is  equivalent  to  Xq  =  {—9-  —  (1  —  0)-)  umax  for 
some  9  £  (0, 1).  In  other  words,  fg(z)  points  towards  z+  if 
and  only  if  z  £  £+.  The  fact  that  fg(z+)  =  0  can  be  verified 
by  substitution,  and  the  last  statement  of  the  claim  follows.  ■ 
Remark  10:  It  is  clear  that  when  a  >  0,  z+  £  Zeg+  where 
Zeq+  is  the  set  of  equilibria  defined  in  Claim  6.  □ 

Claim  10:  If  the  open  loop  system  is  unstable,  ie.  a  >  0, 
and  zq  G  dK+out  IT  Rn,  then  z0  G  £+. 

Proof:  We  will  show  that  if  a  >  0  and  zq  £  dK+out  \ 
£+,  then  Zo  f  Rn  (see  Appendix  B).  If  zo  G  Rn,  we  have 
<t>n(t,Zo)  ->  zego  as  t  — >  oo.  Since  zeq o  G  K,  it  is  sufficient 
to  show  that  if  a  >  0  and  Zo  G  dK+out  \  £+,  then  <j>n(t,  zo)  ^ 
K  for  all  t  >  0.  Let  Zq  =  (xo,umax)  £  d K+out  so  that 
cx0  +  dumax  >  0.  At  the  point  z0,  we  have  /„(z0 )  =  (ax o  + 
bumax ,  cx0  + dumax)-  It  follows  that  u(0)  =  cx0  +  dumax  >  0 
at  time  t  =  0,  and  u(t)  must  increase  (and  hence  sat(w(i))  = 
Umax)  at  least  for  some  non-zero  interval.  The  initial  value 
problem  to  be  considered  is 

x  =  ax  +  bumax,  z(0)  =  Xo, 

u  =  CX  +  du ,  w(o)  =  Umax, 

whose  solution  will  coincide  with  the  solution  of  £n,  ie. 
()>n (t,  zo),  as  long  as  it  remains  outside  K .  We  will  show  that 
u(t)  >  umax  f°r  all  t  >  0,  so  that  <f>n(t,  Zo)  ^  K  for  all  t  >  0. 

If  C  >  0,  we  have  -*Umax  <  -\umax  from  (6).  If  z0  = 
(xQjUmax)  £  &K+out  \  £+>  then  Xq  Satisfies  Xo  ^  a^7 naxi 
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and  hence  T(0)  =  ax o  +  bumax  >  0.  Moreover,  because  a  > 
0,  x(t)  is  non-decreasing  at  least  until  u(t)  <  umax.  Hence 
x(t)  >  Xq  and  cx(t)  >  cxq  during  this  interval. 

If  c  <  0,  then  -dumax  >  umax  from  (6).  If  z0  = 
( X() .  Umax )  £  dK+out  \  £+,  then  Xq  satisfies  Xq  ^ 
and  hence  T(0)  =  axo  +  bumax  <  0.  Moreover,  because  a  > 
0,  x(t)  is  non-increasing  at  least  until  u(t)  <  umax.  Hence 
x(t)  <  Xo  and  cx(t)  >  cx o  during  this  interval. 

In  either  case,  we  have 

u  =  cx  +  du>  cx o  +  du,  tt(0)  =  umax, 

as  the  differential  inequality  governing  u(t).  To  apply  the 
Comparison  Lemma  [8,  Lemma  3.4,  pp.  102  -  103],  define 
v  =  —u,  so  that 

v  <  dv  -  cx0,  v(0)  =  -umax. 

Applying  the  Comparison  Lemma  [8,  Lemma  3.4,  pp.  102 
-  103]  to  the  above  differential  inequality  yields  v(t)  < 
- umaxedt  -  (ed*  -  1),  and  hence 

u{t)  =  -v ;(t)  >  umaxedt  +  2xo  (edt  -  l)  ,  Vf  >  0. 

Since  a  >  0,  it  follows  from  (5)  that  d  <  —a  <  0  and  hence 
(edt  -  1)  <  0  for  all  t  >  0.  Because  cxq  +  dumax  >  0,  we 
have  §ar0  <  -umax  and  jx0  ( edt  -  l)  >  -«mM  (edt  -  l). 

With  these,  the  above  inequality  becomes 

u(t)  >  umaxedt  +  %x0  (edt  -  l)  , 

-2  U max &  ^max  if  l)  —  'Urnax, 

for  all  t  >  0.  ■ 

The  above  results  are  summarized  below. 

Claim  11:  If  there  exists  a  to  £  dK+out  IT  Rn ,  then  for 
every  0  G  1(zq,  z+)  U  {20}.  there  exists  a  T(z)  €  (0, 00)  such 
that  the  solution  of  system  £g  satisfies  <f>g(T(z),  z )  =  2+  and 
4>g{t,z)  G  dIC+out  for  all  t  G  [0,T(z)). 

Proof:  If  a  <  0,  the  result  is  a  direct  consequence 
of  Claim  9  and  the  fact  that  dK+out  U  {2+}  contains  no 
equilibrium  points  of  £g.  If  a  >  0,  then  the  result  follows 
from  Claim  10  and  Claim  9,  and  the  fact  that  £+  U  {z+} 
contains  no  equilibrium  points  of  £9.  ■ 

Remark  11:  Observe  that  under  the  assumptions,  the  solu¬ 
tion  of  the  GPAW  compensated  system  <j>g(t,Zo)  slides  along 
the  line  segment  dI\+out  (or  £+  as  appropriate)  to  reach  2+. 
Note  that  Fact  1  corroborates  this  observation.  □ 

Next,  we  will  show  that  a  solution  of  £„  converging  to 
the  origin  can  intersect  dK+out  or  dK_out  only  in  a  specific 
way,  namely  that  subsequent  intersection  points,  if  any,  must 


steadily  approach  2+  or  2_. 

Claim  12:  If  Zq  G  dK+out  n  Rn  and  there  exists  a  T  G 
(0, 00)  such  that  fn(T,z0 )  G  dK+out,  then  fn(T,z0 )  G 
l(zo,z+). 

Proof:  We  will  show  that  if  <f>n(T,zo)  ^  Z(zo,2+),  then 
Zq  £  Rn.  Let  Zi  :=  fn(T,z0)  and  assume  21  G  dK+out  \ 
Z(2o,Z-|_).  If  zi  =  Zq,  then  the  solution  forms  a  closed  orbit, 
and  due  to  uniqueness  of  solutions,  4>n(t,  20)  will  stay  on  the 
orbit  for  all  £  >  0  and  never  approach  zeqQ.  Hence  Zo  f  Rn. 
Otherwise,  we  have  zi  G  dK+out  \  {1(zq,  z+)  U  {zo}).  Let  the 
closed  bounded  region  enclosed  by  the  closed  path 

fj(z0)  =  {z  G  R2  |  2  =  z0),  Vf  G  [0,T]}  UZ(z0,zi), 

be  D(zq).  Note  that  4>n(t,  Zq)  must  necessarily  intersect 
dK+in  and  enter  K  before  it  can  intersect  dK+out  at  time 
T  due  to  Fact  4.  It  can  be  seen  that  1(zq,Zi)  C  dK+out  is 
a  transverse  section  to  /„,  with  fn  pointing  out  of  D(zq)  on 
1(zq,Zi).  Hence  D(zq)  is  a  negative  invariant  set  of  system 
£„.  If  zeqQ  G  D(zq),  then  there  is  no  way  for  (f>n(t,Zo)  to 
reach  zeqQ,  which  will  prove  the  claim.  We  will  show  that  zeq 0 
must  be  contained  in  D(zq)  using  index  theory  [7,  Section  2.4, 
pp.  49  -  51],  [28,  Section  5.8,  pp.  300  -  305].  Noting  that  the 
index  [7,  Definition  2.16,  pp.  49]  of  a  closed  orbit  is  +1  [28, 
pp.  301],  it  can  be  shown  that  the  index  of  the  closed  path 
77(20),  formed  by  a  section  of  a  trajectory  and  a  transverse 
section,  is  also  +1  [28,  pp.  301  -  302].  The  indices  of  a 
node,  focus  and  saddle  are  +1,  +1,  and  —1  respectively  [28, 
pp.  301].  Since  the  index  of  77(211)  is  the  sum  of  all  indices 
of  equilibria  enclosed  by  77(20)  [28,  pp.  301],  and  system  £„ 
has  only  one  node  or  focus  at  the  origin  with  possibly  two 
additional  saddle  points,  the  only  way  for  77(20)  to  have  an 
index  of  +1  is  for  it  to  enclose  the  origin  zeq 0  alone.  That  is, 
ZeqO  €  -D(zq).  ■ 

Remark  12:  The  above  proof  is  most  evident  by  visualizing 
the  vector  field  fn  on  the  path  77(20).  □ 

The  following  is  the  main  result  of  this  subsection.  The 
proof  amounts  to  using  the  solution  of  £„  to  bound  the 
solution  of  Yjq. 

Proposition  2:  The  part  of  the  ROA  of  the  origin  of  system 
£„  contained  in  K,  is  itself  contained  within  the  ROA  of  the 
origin  of  system  £g,  ie.  (Rn  0  K)  C  Rg. 

Remark  13:  The  distinction  between  the  solutions  of  sys¬ 
tems  £„  and  £s,  namely  fn(t,z )  and  (f>g(t,z ),  and  their 
ROAs,  Rn  and  Rg,  should  be  kept  clear  when  examining  the 
proof  below.  □ 

Proof:  The  following  argument  will  be  used  repeatedly  in 
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the  present  proof.  If  for  some  z  £  K,  we  have  <f>n(t ,  z )  €  K 
for  all  t  >  0,  then  Fact  4  implies  that  <f)n(t,  z)  cannot  intersect 
d K+out  or  dK_out,  ie.  4>n{t,z)  £  K  \  ( dK+out  U  dK_out ) 
for  all  t  >  0.  Fact  2  shows  that  /„  and  fg  coincide  in  K  \ 
(dK+outUdK_ovt),  which  implies  </>g(t,z)  =  (j>n(t,z)  for  all 
t  >  0.  If  in  addition,  we  have  lim t^>oo4>n{t,z)  =  zeq o,  then 
lim t^oo  <j)g(t,  z)  =  lim^oo  0n(t,  z)  =  zeq0.  In  summary,  if 
4>n(t,  z)  £  K  for  all  t  >  0  and  z  £  Rn,  then  2  £  Rg.  For  ease 
of  reference,  we  call  this  the  coincidence  argument. 

We  need  to  show  that  if  Zq  £  Rn  T  K,  then  Zq  £  Rg.  Let 
Zq  £  Rn  n  K,  so  that  (j)n(0,zo)  =  zq  £  K,  and  <j>n{t,Zo)  — » 
zeq o  as  t,  — »  oo.  Consider  the  case  where  <j>n(t,  zo)  stays  in  K 
for  all  t  >  0.  It  follows  from  the  coincidence  argument  that 

Zq  £  Rg. 

Now,  we  let  the  solution  <j>n(t,Zo)  enter  K+  and  con¬ 
sider  all  possible  continuations.  Due  to  Fact  4,  <j>n(t,Zo) 
must  intersect  dK+out  at  least  once.  If  (f>n(t,  Zq)  intersects 
dK+out  multiple  times,  it  can  only  intersect  it  for  finitely 
many  times.  Otherwise,  there  is  an  infinite  sequence  of  times 
tm,m  £  {l,2,...,oo}  such  that  tm  |  oo  as  rn  — >  oo  for 
which  <t>n{tm,Zo)  £  dK+out.  Since  Zo  £  Rn ,  it  follows  that 
4>n(tm ,  zo)  £  dK+out  H  Rn  for  every  m.  As  a  consequence  of 
Claim  12,  we  have  lim m->oo  finitm,  zo)  =  z+,  which  shows 
that  z+  is  an  u>  limit  point  of  <f)n(t,  Zo).  But  this  is  impossible 
because  lim^oo  cj>n(t,  z0)  =  zeq0  ^  z+.  Similarly,  if  cj>n(t,  z0) 
intersects  dK_out  multiple  times,  it  can  only  intersect  it  for 
finitely  many  times. 

Hence,  let  T)  and  T2  be  the  first  and  last  times  for  which 
< f>n(t ,  zo)  intersects  dK+out,  and  let  T3  be  the  (only)  time  after 
T2  that  <j>n(t,Zo)  intersects  dK+in.  Then  we  have  0  <  T\  < 
T2  <  T3  <  00  and  Zo)  £  K+  for  all  t  £  (T),  X3), 
</>n(Ti,Zo),0„(T2,Zo)  £  dK+out,  and  0„(r3,zo)  £  dK+in, 
with  behavior  after  T3  to  be  specified.  Let  z\  =  4>n[T\ ,  zq)  £ 
dK+out,  z2  =  MT2,z0)  £  dK+out  and  z3  =  4>n(T3,z0)  £ 
dK+in.  Since  z0  £  Rn ,  we  have  Zi,z2  £  dK+out  0  Rn  and 
z3  £  dK+in  D  Rn.  It  is  clear  that  4>g(t,z0)  =  4>n{t,z0)  for 
all  t  £  [0,Ti],  By  Claim  11,  there  exist  a  Ti  <  00  such  that 
<t>g(Tl+Tl,Z0)  =  <j)g(T\,  (j>g(Ti,  Zo))  =  <fig(T\,  4>n(T\,  Z0))  = 
4>g(T\,Z\)  =  z+.  Because  <f>n(t,Zo)  cannot  intersect  dK+out 
for  all  t  >  T2,  the  only  possible  continuations  from  time  T3 
(>  T2)  onwards  are 

(i)  <j)n(t ,  Zo)  stays  in  K  for  all  t  >  T3,  or 

(ii)  <t>n(t,Zo)  enters  at  some  finite  time. 

Consider  case  (i),  which  implies  D(z3)  C  K.  Claim  8 
yields  z+  £  D(z3)  C  Rn,  and  Claim  7  shows  that  D(z3) 
is  a  positive  invariant  set  for  system  £n.  Then  we  have 


<pn(t,  z+)  £  D{z3)  C  K  for  all  t  >  0.  It  follows  from  the 
coincidence  argument  that  z+  £  Rg.  Because  <j)g(t,  z+)  = 
(pgit.  (pg(T-\  +  Ti,zo))  for  all  t  >  0,  we  have  zo  £  Rg,  as 

desired. 

Now,  consider  case  (ii).  Due  to  Fact  4,  <j>n(t,zo)  must 
intersect  dK_out  at  least  once.  From  the  above  discussion, 
cj)n(t,zo)  can  intersect  dK_out  only  finitely  many  times.  Let 
T4  be  the  first  time  (after  T3 )  and  X5  be  the  last  time  for 
which  cj)n(t,Zo)  intersects  dK_out ,  and  let  Tq  be  the  (only) 
time  after  T5  that  Zq)  intersects  dK_in.  Then  T3  <T3< 
T5  <  T6  <  00  and  cj)n(t,z0)  £  K_  for  all  t  £  (T5,Te), 
^0)5  tj)n(T^^  Zo)  £  dI\-out.  and  (j>n(To,Zo)  £  dR—in. 
Let  Z4  =  0„(T4,zo)  £  dI\—out ,  Z5  =  (/)n(T5,z0)  £  dR~out 
and  Zq  =  </>n(T6,zo)  £  dK_in.  Since  Zo  £  Rn,  we  have 
Z4,  Z5  £  dK_out  n  Rn  and  Z6  £  dK_in  n  Rn.  Now,  the 
only  possible  continuation  after  Tq  is  for  <f>n(t,Zo)  £  K  for 
all  t  >  Te.  Recall  the  definition  of  //(z)  and  F)(z)  for  some 
z  £  dK+in  D  Rn,  as  illustrated  in  Fig.  3.  It  is  clear  that 
z+  £  D(z3).  Claim  7  shows  that  D(z3)  (with  a  portion  in  /C_) 
is  a  positive  invariant  set  for  system  £„,  so  that  <j>n(t,z+)  £ 
D(z3 )  for  all  t  >  0.  Recall  also,  that  <j>g(Ti  +  Ti,Zo)  =  z+ 
and  we  want  to  show  that  z+  £  Rg.  There  are  two  possible 
ways  for  the  solution  <j>n(t.  z+)  to  continue.  Either  <j>n(t,z+) 
stays  in  D{z3)  ft  K  for  all  t  >  0,  or  it  enters  D(z3)  IT  /C_ 
at  some  finite  time.  If  z+)  £  D(z3 )  T  K  for  all  t  >  0, 
then  as  in  the  proof  of  Claim  8,  Bendixson’s  Criterion  [8, 
Lemma  2.2,  pp.  67]  and  the  absence  of  saddle  points  in 
D(z3)  T  K  means  that  {zeq 0}  is  the  to  limit  set  of  <j>n(t,  z+) 
and  hence  z+  £  Rn.  By  the  coincidence  argument,  we  have 
z+  £  Rg.  It  follows  from  <f>g(t,z+)  =  +fi,z0)) 

for  all  t  >  0,  that  Zo  £  Rg.  Finally,  consider  when  < pn(t,z+ ) 
enters  D{z3)  T  K_  at  some  finite  time.  By  Fact  4,  <j>n(t ,  z+) 
must  intersect  dK-out  at  least  once.  Let  T2  <  00  be  such  that 
<j>n{f2,z+)  £  dK^out  and  (j>n(t,z+)  £  K  for  all  t  £  (0 ,T2), 
and  let  z2  =  </>„(T2,  z+)  £  dK_out.  Because  the  boundary  of 
D(z3)  intersects  dK_out  at  Z4  and  z2  £  D(z3)  C\dK_out,  we 
have  that  z2  £  l(z4,z_).  Since  Z4  £  dK-out  T  Rn,  we  have 
by  (the  analogous  counterpart  to)  Claim  1 1  that  there  exists  a 
T3  <  00  such  that  <t>g(T3,  z2)  =  z_.  Since  Z6  £  dI\—inr\Rn,  it 
follows  from  (the  analogous  counterparts  to)  Claims  8  and  7 
that  z_  £  D(zq)  C  Rn,  D(zq)  is  a  positive  invariant  set, 
and  <f>n(t,Z-)  £  D(zq)  C  K  for  all  t  >  0.  The  coincidence 
argument  then  yields  z_  £  Rg.  Since  <j>n(t,z+)  £  K  U  {z+} 
for  all  t  £  [0,T2),  Fact  2  implies  that  <f>g(t,z+)  =  <f>n(t,z+) 
for  all  t  £  [0,T2].  We  can  trace  back  the  path  to  zo  by 
observing  that  <j>g(t,Z-)  =  <j>g(t,  <j)g{T3,  z2))  =  </>g(t  + 
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T3,  Z2)  =  fg(t  +  T3,  <j>n(f2,  2+))  =  (j)g{t  +  T3,  <j)g(f2,  Z+))  = 

4>g{t  +  T3  +  T2 ,  z+ )  =  <f)g(t  +  T3  +  T2 ,  4>g(T\  +  Ti,  zo))  for 
all  t  >  0.  Since  (E  Rg ,  we  have  G  i?ff,  as  desired. 

In  similar  manner,  it  can  be  shown  that  if  z{)  £  Rn  D  K  and 
the  solution  <pn(t,  Zq)  enters  K_  first,  then  zq  £  Rg.  ■ 

Observe  that  the  partial  result  stated  in  Proposition  2  is 
practically  meaningful  because  the  controller  state  can  usually 
be  initialized  in  a  manner  such  that  the  system  state  is  in  the 
unsaturated  region. 


B.  ROA  Containment  in  Saturated  Region 

In  this  subsection,  we  show  that  the  ROA  containment 
also  holds  in  the  saturated  region.  What  follows  is  a  series 
of  intermediate  claims  to  arrive  at  the  main  result  of  this 
subsection.  Proposition  3. 

Define  the  line  segments 

Ct+div  *=  9R-\ -div  n  |(x,rt)  £  R.  u  ^Umax} , 
tt—div  •  &I\—di% i  O  |(x,'u)  £  R.  |  U  >  , 

CT -\-div  • —  dK+div  \  CT+div,  tt—div  • —  OK  —  div  \  tT—div 

It  can  be  verified  that  cr+div  =  Kz+,zeq+),  V-div  = 
l(z-,zeq-),  zeq+  £  cr+div  and  zeq _  £  d-diV  whenever 
ad  <  0. 

Claim  13:  If  the  open  loop  system  is 

(i)  marginally  stable  (a  =  0),  or  strictly  stable  with  a  stable 
controller  (a  <  0  and  d  <  0),  then  dK+diV  is  a  transverse 
section  to  /„. 

(ii)  strictly  stable  with  an  unstable  controller  (a  <  0  and  d  £ 
(0,  —a)),  or  unstable  (a  >  0),  then  a+diV  (C  dK+dlv)  is 
a  transverse  section  to  /„. 

Proof:  Since  ct+div  C  dK+div  C  K+,  we  only  need 
to  consider  /„  in  K+.  For  any  z  £  K+,  we  have  fn(z)  = 
f  n(x,u)  =  (ax+bumax  >  CX+du)  .  Let  T Z+  =  (Umax,  ^Umax) ■ 
For  case  (i)  (respectively,  (ii)),  it  can  be  verified  that  T  ^+m  is  a 
unit  normal  of  dK+div  (respectively,  cr+diV).  We  need  to  show 
that  (Tz+,  fn(z))  ^  0  for  all  2  £  dK+div  (respectively,  2  £ 
cr+div).  Any  z  £  dK+diV  can  be  expressed  as  0  =  (x,  u)  = 
(—^u,u)  for  some  u  >  umax.  On  any  point  z  £  dK+diV, 
direct  computation  yields 


(■ Tz+,fn(z ))  =  {(umax,£Umax)  ,  (aX  +  bumax ,  CX  +  du))  , 
(( Umax ,  £'Umax')  ,  (  ptl  +  bll.max^(fj^  , 

=  (  £U  b'Umax )  Umax, 

—  ~(adu  bcUmax'j'Umax, 


For  case  (i),  we  have  ad  >  0,  so  that  adu  >  adumax  > 
bcumax,  where  the  last  inequality  is  due  to  (6).  Then  adu  — 
bcumax  >  0,  and  we  have  (Tz+,  fn(z))  0  for  all  2  £ 
dK+diV,  as  desired. 

For  case  (ii),  it  can  be  verified  that  ad  <  0  due  in  part 
to  (5)  (d  <  —a  <  0  when  a  >  0).  Then  ||  >  1  due  to  (6) 
and  cr+div  ±  0-  On  dK+diV,  (Tz+,fn(z))  =  0  can  hold  if 
and  only  if  adu  —  bcumax  =  0.  This  is  assured  on  any  point 

Z  =  (x,u)  £  Ct+div  C  0I\+div  due  to  U  ^ Umax •  ® 

Remark  14:  For  case  (ii),  the  proof  also  shows  that  d+div  \ 
{zeq+}  is  also  a  transverse  section  to  /„.  □ 

Claim  14:  If  the  open  loop  system  is 

(i)  strictly  stable  with  an  unstable  controller  (a  <  0  and 
d  £  (0,  —a)),  or 

(ii)  unstable  (a  >  0), 

and  z0  £  Rn,  then  z0  qL  cr+div 

Proof:  We  will  show  that  if  zo  £  d+div,  then  Zo  ^  Rn- 
If  Zq  €  Rn,  we  have  fn(t,Zo)  — >  zeq o  as  t  — >  oo.  Since 
zeqO  C:  K,  it  is  sufficient  to  show  that  if  zq  £  d+diV,  then 
fn(t,Zo)  ^  I\  for  all  t  >  0.  It  can  be  verified  that  ad  <  0, 
due  in  part  to  (5)  (d  <  —a  <  0  when  a  >  0).  Then  (6)  yields 
^2  >  1.  Let  z0  =  (x0,u0)  £  d+div,  so  that  u0  >  ^ «mol  > 
Umax  and  cxq  +  duo  =  0.  Since  Zo  €  d+diV  C  K+,  consider 
the  initial  value  problem 

x  =  ax  +  bumax,  x(0)  =  x0, 

u  =  cx  +  du,  «(0)  =  uq, 

whose  solution  will  coincide  with  cf>n(t,Zo)  as  long  as  it 
remains  in  I\+  U  0K+.  Solving  for  x(t)  yields 

x(t)  =  X0eat  +  ^Umax(eat  -  1),  Vf  >  0. 

We  will  show  that  u(t)  >  umax  for  all  t  >  0,  so  that 
(j>n(t,  zq)  I<  for  all  t  >  0. 

Consider  case  (i)  (a  <  0  and  d  £  (0,  —a)).  Define  v  = 
u  —  uq  so  that  v  =  ii  =  cx  +  du  =  dv  +  (cx  +  duo),  and 

consider 

v  =  dv  +  (cx  +  duo),  x(0)  =  u(0)  —  uq  =  0. 

Clearly,  if  v(t)  =  u(t )  —  Uq  >  0  for  all  t  >  0,  then  u(t)  > 
uq  >  2!  umax  >  Umax  f°r  all  t  >  0,  and  the  conclusion 
follows.  Since  d  >  0,  a  sufficient  condition  is  for  the  input  of 
the  preceding  ordinary  differential  equation  to  satisfy  cx(t)  + 
duo  >  0  for  all  t  >  0.  Using  cx o  +  duo  =  0  and  the  solution 
of  x(t),  we  have 


for  some  u  >  umax- 


cx(t )  +  du0  =  cx0eat  +  !fumax(eat  -  1)  +  duo, 
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=  -du0eat  +  ^umax(eat  -  1)  +  du0, 

=  ( du0  -  *fumax)  (1  -  eat), 

=  d(u0-  ^um ax)  (1  -  eat)  >  0, 

for  all  t  >  0,  where  the  final  inequality  is  due  to  a  <  0,  d  >  0 

and  M0  ^  7777  Urn.ax  • 

Now  consider  case  (ii)  (a  >  0).  From  (5),  we  have  d  < 
— a  <  0.  In  turn,  we  have  — umax  >  duo  due  to  it0  >  7777 umax . 
Because  a  >  0,  we  have  eat  —  1  >  0  for  all  t  >  0.  The 
evolution  of  cx(t)  then  satisfy 

exit)  =  c(x0eat  +  | Umax(eat  -  1)), 

>  cx oeat  +  duo(eat  —  1)  =  —  duo  =  cx o, 

for  all  t  >  0,  due  to  cx o  +  duo  =  0.  Then  u(t)  is  governed 
by  the  differential  inequality 

u  =  cx  +  du>  cx o  +  du,  u(0)  =  uq. 

In  similar  manner  as  the  proof  of  Claim  10,  define  v  =  —u, 
so  that 


v  <  dv  —  cx  o, 


F(0)  =  uq  . 


Zln  lln  ( Xri ,  V.  fi )  —  CXn  T  dun,  Myj(0)  U() . 

as  long  as  un(t)  >  umax,  ie.  for  all  t  <  Tn.  The  solution  of 
the  GPAW  compensated  system,  <j>g(t,zo)  =  (xg(t),  ug(t)),  is 
governed  by 

Xg  —  UXg  bumax  ,  —  ^0 : 

^ g  =  Mg(0)  =  No¬ 

where 

JO,  if  cxg  +  dug  >  0, 

hg[Xg,  Ug)  —  < 

lca;g  +  c?Mg,  otherwise, 

as  long  as  ug(t)  >  Umax ■  We  need  to  show  that  there 
exists  a  Tg  £  (0,oo)  such  that  Tg  <  Tn  and  4>g(Tg,  z0)  e 
l(z+i<j>n(Tn,z0)). 

Solving  the  initial  value  problem 


=  ax  +  bumax ,  x(0)  =  x0, 


yields 

x(t)  = 


Xo  bUmaxt) 


if  a  =  0, 


x0eat  +  77 umax{eat  -  1),  otherwise, 


(13) 


Applying  the  Comparison  Lemma  [8,  Lemma  3.4,  pp.  102 
-  103]  to  the  above  differential  inequality  yields  v(t)  < 
—u0edt  —  ^Xo  (edt  —  l)-  Using  cx0  +  du0  =  0,  we  have 

u(t)  =  -v (t)  >  u0edt  +  |x0  {edt  -  l)  , 

=  \  ( du0edt  +  cx 0  (edt  -  l))  , 

for  all  t  >  0.  ■ 

Claim  15:  If  Zo  £  K+out  Cl  Rn ,  then  there  exists  a  Tg  £ 
(0, 00)  such  that  the  solution  of  the  GPAW  compensated 
system  satisfy  <j>g(Tg,z0)  £  l{z+,  c/)n(Tn,  z0))  C  dK+in, 
where  Tn  £  (0, 00)  is  such  that  the  solution  of  the  nominal 
system  satisfy  <j>n(Tn,zo)  £  dK+in  and  (j>n(t,Zo)  £  K+  for 
all  t  £  [0,  Tn).  Moreover,  Tg  <  Tn  <  00  holds. 

Proof:  Let  Zq  =  (xq,Uq)  £  K+out  H  R.n,  so  that  m0  > 
Umax,  CX0  +  du0  >  0,  and  4>n(t,  z0)  — >  zeq 0  as  t  — >  oo. 
Since  zeq o  £  K  and  Zq  £  K+out  C  K+,  Fact  3  shows  that 
cj)n(t,zf)  must  intersect  dK+in  at  some  finite  time.  Let  T„ 
be  the  first  time  instant  that  </>n(t,zo)  intersects  dK+tn.  Then 
Tn  £  (0,  oo),  fn{Tn,z0 )  £  dK+in  and  fn{t,z0)  £  I\+  for 
all  t  £  [0, Tn).  It  is  clear  that  l(z+,<f>n(Tn,zo))  C  dK+in. 

The  solution  of  the  nominal  system,  <j>n{t,Zo)  = 
(xn(t),un(t)),  is  governed  by 

Xji  —  (lXn  bUmax ,  *£ti((1)  Xq, 


for  all  t  >  0.  It  can  be  seen  that  xn(t)  =  x(f)  for  all  t  such  that 
un(t)  >  Umax -  and  Xg(t)  =  x(t)  for  all  t  such  that  ug(t)  > 
Umax ■  Let  Tg  —  inf{f  £  (0,oo)  |  uq{f)  f  Mmaa,},  ie.  Tg  is 
the  first  time  instant  that  <j>g(t,Zo)  intersects  dK+in ,  or  oo  if 
cf>g(t,zo)  never  intersects  dK+in.  With  T  :=  min{T„,Tg}, 
the  preceding  relations  yield  xn(t)  =  xg(t)  =  x(t)  for  all 
t  £  [0,T].  Hence  xn(t)  and  xg(t)  are  well  defined  at  least  for 
all  t  £  [0,T],  and  we  have 

b'nif ,  un{tf)  . —  hn (xn {t ) ,  un {t ))  —  cx(t)  dun(t), 

hg{t,Ug{t))  :=  hg(Xg{f)  ,Ug(t)) 

0,  if  cx(<)  +  dug(t)  >  0, 

cx(f)  +  dug(t),  otherwise. 

Observe  that  whenever  cx(t)  +  dug(t)  >  0,  we  have 

hn(t,Ug(t))  >  hg(t,Ug(t)).  Wlldl  CX  (t )  +  dU  g  (t)  <  0, 

we  have  hn(t,ug(t))  =  hg(t,ug(t)).  Hence  hg(t,ug(i))  < 
hn(t,ug(t))  for  all  ug(t)  >  umax,  for  all  t  £  [0,T], 

The  solution  of  ug(t)  is  clearly  governed  by  the  differential 
inequality 

Ugif)  ^  hn(t,  Ug(t)),  Ug(0)  -  UQ  , 

for  all  t  £  [0,T],  By  the  Comparison  Lemma  [8,  Lemma  3.4, 
pp.  102  -  103],  we  have  ug(t)  <  u„(t )  for  all  t  £  [0,T], 

To  obtain  a  strict  inequality,  observe  that  cx(0)  +  dun(0)  = 


15 


cx( 0)  +  dug( 0)  =  cx o  +  duo  >  0  holds  with  strict  in¬ 
equality.  Then  for  any  sufficiently  small  5  >  0  such  that 
cx(t)  +  dun(t)  >  0,  cx{t)  +  dug(t)  >  0,  for  all  t  £  [0,(5],  there 
exists  an  e  =  e(<5)  >  0  such  that  un(S )  =  uq  +  e.  Moreover, 
we  have  ug(6)  =  uq  due  to  ug(t)  =  0  for  all  t  €  [0,(5].  In 
other  words,  defining  us  :=  uo  +  e,  we  have 

un  (t)  =  K  (t ,  un  (t) ) ,  un  ((5)  =  us , 

Ug(t)  <  hn(t,Ug(t)),  Ug(6)  <  us- 

Applying  Lemma  1  (see  Appendix  C)  to  the  preceding,  we 
get  the  strict  condition  ug(t)  <  un(t)  for  all  t  £  [<5, T\.  Since 
6  >  0  is  only  required  to  be  small  but  otherwise  arbitrary,  we 
have  ug{t)  <  un(t)  for  all  t  £  (0,  T], 

Assume  for  the  sake  of  contradiction  that  <f>g(t,Zo)  never 
intersects  dK+in.  Then  Tg  =  oo  by  its  definition  and  T  := 
min{T„, Tg}  =  Tn  <  oo.  Since  (pn(Tn,z0 )  £  dK+in,  we 
have  un(Tn)  =  umax-  The  condition  ug(t)  <  un(t)  for  all  t  £ 
(0,  Tn]  yields  ug(Tn)  <  un(Tn)  =  umax ■  This,  coupled  with 
rtg(0)  =  u o  >  umax  and  continuity  of  ug(t)  means  that  there 
exists  a  T  £  (0 ,T„)  such  that  ug(T)  =  umax-  This  contradicts 
the  assumption  that  (pg(t,  z o)  never  intersects  dK+in ,  and  also 
shows  that  Tg  =  T  <  Tn  <  oo  and  <f>g(Tg,zo)  £  dK+in.  It 
remains  to  show  that  (pg(Tg,z0)  £  l(z+,  cpn(Tn,  z0))- 

Since  z0  £  K+out  and  (f>n(Tn,  z0),(f>g(Tg,  z0)  £  dK+in, 
both  (f>n(t,Zo)  and  <f>g(t,Zo)  must  intersect  dK+diV  at  least 
once.  Let  Tndiv  £  (0 ,Tn)  and  Tgdiv  £  (0 ,Tg)  be  the  first 
time  instants  that  (pn(t,Zo)  and  (j>g(t,Zo)  intersect  dK+div,  so 
that  (j>n(t,  z0)  £  K+out  for  all  t  £  [0 ,Tndiv)  and  <j)g(t,z0 )  £ 
K+out  for  all  t  £  [0,  Tgdiv).  This  implies  that  cx(t)+dug(t)  > 
0  for  all  t  £  [0 ,Tgdiv),  so  that  ug{t)  =  0  and  ug(t)  =  uq 
for  all  t  £  [0 ,Tgdiv],  It  also  implies  that  un(t )  =  cx{t)  + 
dun{t)  >  0  for  all  t  £  [0 ,Tndiv),  so  that  un[Tndiv)  >  u0. 
Then  we  have  umax  <  u0  =  ug(Tgdiv )  <  un(Tndiv ),  which 
implies  (ft g{TgdiV ^  z^)  £  l(z+.  0n  ,  z^ ] ]  CZ  0I£ .  Let 

Zn  •  z  (pn C^ndiv 5  ) )  zg  ;=  (ft g{TgdiV ,  z 0),  and  let  the  closed 
bounded  region  enclosed  by  the  closed  path 

fj(zn)  :=  l(z+,zn)  U  fj^fzn)  U  l(z+,<j)n(Tn,z0))  U  {z+}, 

where 

V^iZn)  =  {z  £  K2  I  2:  =  (pn(t,z0),\/t  £  [ Tndiv,Tn ]}, 

be  D(zn). 

If  the  open  loop  system  is  marginally  stable  (a  =  0)  or 
strictly  stable  with  a  stable  controller  (a  <  0  and  d  <  0), 
Claim  13  shows  that  dK+diV  is  a  transverse  section  to  fn. 
Since  cpn(t ,  Zq)  traverses  from  K+out  through  zn  £  dK+diV  to 


K+i„,  all  trajectories  of  S„  intersecting  the  transverse  section 
dK+diV  can  only  pass  from  K+out  to  K+in,  ie.  they  cannot 
pass  from  K+in  to  K+out  through  dK+diV.  This  implies 
that  <f>n(t,zo)  can  never  return  to  K+out  within  the  interval 
[Tndiv,  Tn],  and  D(zn)  is  contained  in  I<+in  U  dK+div  U 
d K+in  U  {z+}.  Moreover,  l(z+,zn)  C  dK+diV  is  also  a 
transverse  section  to  fn. 

If  the  open  loop  system  is  strictly  stable  with  an  unstable 
controller  (o  <  0  and  d  £  (0,  —a)),  or  unstable  (a  >  0),  the 
assumption  zq  £  Rn  and  Claim  14  implies  zn  £  cr+diV,  and 
that  (pn(t,zo)  qL  a-+diV  for  all  t  £  [0,  Tn],  Claim  13  shows 
that  cr+diV  is  a  transverse  section  to  /„,  which  by  the  same 
reasoning,  implies  that  cpn(t,Zo)  can  never  return  to  K+out 
within  the  interval  [ TndiV,Tn ],  and  D(zn )  is  contained  in 
K+m  U  a+div  U  dK+in  U  {2+}  (C  K+in  U  dK+div  U  dK+in  U 
{2-|_}).  Moreover,  l(z+,zn)  C  a+diV  is  also  a  transverse 
section  to  /„. 

By  Claim  2,  the  solutions  of  system  En  are  unique, 
so  that  no  two  different  paths  can  intersect  [9,  pp.  38]. 
Hence,  no  solution  starting  in  D(zn)  \  fj^^fzn)  can  reach 
fi(f)n (2n),  or  exit  D(z„)  through  the  segment  fj^n(zn).  This, 
together  with  the  fact  that  l(z+,zn)  is  a  transverse  section 
and  zg  £  l(z+,zn)  C  D(zn )  \  rj^Zn),  means  that  zg) 
can  exit  the  region  D(zn )  only  through  the  line  segment 
l(z+,<j>n(Tn,z0))  C  dK+in.  By  Fact  2,  fn  and  fg  coincide 
in  D(zn)  C  K+in  U  dK+div  U  dK+in  U  {z+},  so  that 
(pg{t,zg)  =  (pn(t,zg )  at  least  until  <j>n(t,zg)  exits  D(zn ), 
ie.  until  t  Tg  Tgdiv ,  where  (pg{Tg  igii/ru •  zg)  — 
4>g(.Tg  Tgdiv ,  (pg  [Tgdiv ,  2o))  (pg(Tg,Zof  £  Ols+in.  It 

follows  that  <f>g(t,zg)  can  exit  D(zn)  only  through  the  line 
segment  l(z+,  (pn{Tn ,  20)),  ie.  (pg(Tg,  20)  £  l{z+ ,  (pn{Tn,  20)), 
as  desired.  ■ 

Remark  15:  In  fact,  a  weaker  version  of  Claim  15  (where 
the  conclusion  is  that  a  Tg  <Tn  exists  such  that  (pg(Tg,  zo)  £ 
l(z+,cf>n(Tn,z0))  U  {<pn(Tn,  Zo)j)  suffices  for  the  purpose  of 
proving  Proposition  3.  The  proof  would  have  been  shorter, 
as  the  condition  ug(t)  <  un(t)  for  all  t  £  (0,T[  would 
be  unnecessary.  We  present  this  marginally  stronger  result  to 
confirm  the  intuitively  reasonable  conclusion.  □ 

Consider  a  point  zq  £  fl  Rg.  From  Fact  1,  we  have 

( pg(t,Zo )  £  K  for  all  t  >  0.  Recall  the  definition  of  n  \ 
(see  (10)),  and  let 

tint  =  inf{i  £  (0,  oo)  |  (pg(t,z0)  £  cr+}. 

In  other  words,  tlnt  is  the  first  time  instant  that  the  solution 
of  the  GPAW  compensated  system  (f>g(t,zo)  intersects  cr+,  or 
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Fig.  4:  Close  path  7(2:0)  encloses  region  E(zf)  C  K.  A 
case  where  the  solution  intersects  dI\_out,  then  intersects  <r+ 
is  shown  on  the  left.  A  case  where  the  solution  intersects 
dK+out,  then  intersects  <7+  at  z+  is  shown  on  the  right. 


00  if  it  does  not  intersect  <r+.  If  trnt  <  00,  the  path 

Jintizo)  =  rfint<\)g  (z0)  u  l(<j)g(tinU  z0),  z+)  U  {2+} 

U  l(z0,z+), 

where 

7int<£B(Zo)  =  {z  G  K2  I  2:  =  (j>g(t,Z0)yt  G  [0 .tint]}, 

is  well  defined.  Otherwise,  the  path 

7o(ai)  =  7o0s(“o)  U  {zeq 0}  U  a+  U  l(z0,z+), 

where 

7o^fl(2o)  =  {2  G  K2  I  2:  =  <j>g(t,  Zo),Vt  >  0}, 

is  well  defined.  Now,  define  the  path  7(2:0)  G  K2  by 

,  ,  |  7inl(*o)t  tf  tint  ^  tX), 

7(^0)  =  < 

[70(20),  otherwise, 

which  can  be  verified  to  be  closed  and  connected.  Let  the 
open,  bounded  region  enclosed  by  7(20)  be  E(zq),  and  its 
closure  be  E(zf).  The  region  E(zf)  is  illustrated  in  Fig.  4. 

Remark  16:  Observe  that  2+  G  cr+.  If  f,;„/  <  00  and 
4>g(tint,z0)  =  2+  G  er+,  then  7int(20)  reduces  to 


7int(Zo)  =  7mi0B(~o)  U  l(z0,Z+), 
since  l((j>g(tint,  z0),  z+)  =  l(z+,z+ )  =  {2+}  and  z+  G 

'linttpg  (A))  • 

The  following  result  is  analogous  to  Claims  7  and  8  com¬ 
bined,  with  respect  to  E(zf). 

Claim  16:  If  20  G  dK+in  0  Rg,  then  E(zf)  C  K  is 
a  positive  invariant  set  for  system  Eg.  Moreover,  E(z0)  is 
contained  in  the  ROA  of  system  Eg,  and  it  must  contain  2ego, 
ie.  E(z0)  C  Rg  and  zeq0  G  E(z0). 

Proof:  Let 

{l(tfg  ( tint ,  2o)  ,  2+)  U  {^,+  } ,  if  tint  OO , 

<7+,  otherwise. 


Observing  from  Fact  2  that  fn  and  fg  coincide  on  <7+  C 
K  U  {2+},  it  can  be  verified  as  in  the  proof  of  Claim  7,  that 
<7+  is  a  transverse  section  to  fg  and  fg  always  points  into 
E(zq)  on  <f+.  It  is  clear  that  ^(20,2+)  C  dK+in  is  also  a 
transverse  section  to  fg,  and  that  fg  always  points  into  E(zq ) 
on  Z (2:0,2+).  Both  of  these  results  show  that  any  solution 
originating  in  E(zq)  cannot  exit  E(zo)  through  the  line 
segments  er+  or  1(zq,z+).  Furthermore,  the  solution  <pg(t,zo) 
is  unique  due  to  Proposition  1,  which  implies  that  no  solution 
originating  in  E{zf)  can  exit  it  through  the  boundary  700  (20) 
(or  'Yint<j>g{zo)  as  appropriate)  (see  Remark  4).  These  show 
that  the  region  E(zq)  enclosed  by  7(20)  must  be  a  positive 
invariant  set  for  system  Eg.  Fact  1  shows  that  <pg(t,zo)  G  K 
for  all  t  >  0,  which  implies  E(zq)  C  K.  This  proves  the  first 
statement. 

Since  20  G  Rg,  we  have  </>g(t,  20)  — ►  2ego  as  t  — >  00.  Since 
E(zf)  is  a  positive  invariant  set  and  zq  G  E(zf),  we  have 
< f>g(t,zo )  G  E(zq)  for  all  t  >  0.  The  conclusion  zeq 0  G  E(zq) 

then  follows  from  the  fact  that  E(zq)  is  closed  and  hence 
contains  all  its  limit  points. 

It  remains  to  show  that  E(zq)  C  Rg.  If  E(zo)  (7  dK+out 
0,  it  can  be  verified  that  it  must  lie  in  the  line  segments 
7o0s(2o)  (or  7mt0B(2O)),  ie.  (^(20)  7  dK+out)  C  7o«4B(^o) 
(or  ( E(z0 )  7  dK+out)  C  7mt0B  (20))-  Hence  any  solution  of 
Eg  starting  in  E(zq)  that  intersects  dK+out  must  intersect 
4>g{t,  20)  at  some  time.  Since  lim^oo  cj)g(t,  z0)  =  zeq0,  it 
follows  from  uniqueness  of  solutions  that  any  solution  starting 
from  a  point  2  G  E(zq)  that  intersects  dK+out  must  converge 
to  zeq 0,  ie.  z  G  Rg.  In  similar  manner,  any  solution  starting 
from  a  point  z  G  E{zq)  that  intersects  dK_out  must  converge 
to  2ego,  ie.  z  &  Rg.  It  suffices  to  consider  solutions  that  do 
not  intersect  dK+out  U  dK-out,  ie.  solutions  contained  in 
E(z0)  :=  E(zo)  \  (dK+out  U  dK_out). 

It  can  be  verified  from  Claim  6  that  any  equilibria  of  Eg 
apart  from  zeq 0  contained  in  E(zq)  must  lie  in  8K+out  U 
dK_out.  Then  the  only  equilibrium  point  in  E(zq)  (C  E(zq)) 
is  zeq 0,  which  must  be  a  stable  node  or  focus.  Observe 
that  fg  is  continuously  differentiable  in  E(zq)  C  K  U 
dK+inUdK_in  U  {2+,  2_},  so  that  Bendixson’s  Criterion  [8, 
Lemma  2.2,  pp.  67]  applies  in  this  region.  As  in  the  proof  of 
Claim  8,  Bendixson’s  Criterion  [8,  Lemma  2.2,  pp.  67]  and 
the  absence  of  saddle  points  in  E(zq)  means  that  {2ego}  is 
the  ui  limit  set  of  every  solution  contained  in  E(zq).  Hence 
E(ztf)  C  Rg,  and  the  conclusion  follows.  ■ 

The  following  is  the  main  result  of  this  subsection. 

Proposition  3:  The  part  of  the  ROA  of  the  origin  of  system 
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£„  contained  in  R2  \  K,  is  itself  contained  within  the  ROA 
of  the  origin  of  system  £g,  ie.  ( Rn  fl  (R2  \  K))  C  Rg. 

Proof:  We  need  to  show  that  if  zq  £  Rn  H  (R2  \  K ),  then 
Zq  £  Rg.  First,  observe  that  R 2  \  K  =  K+  U  K_,  and  K+  = 
K+out  U  K+ln  U  dK+(nv.  We  will  show  that  if  zq  £  RnnK+, 
then  Zq  £  Rg.  The  proof  where  Zq  £  Rn  (T  K-  is  similar.  Let 
Zq  £  Rn  fl  K+.  Since  Zq  €  Rn  and  zeq o  £  K,  Fact  3  shows 
that  cf>n(t,Zo )  must  intersect  dK+in  at  least  once.  Let  T  be 
the  first  time  instant  that  zq)  intersects  dK+in,  so  that 
4>n(T,z0 )  £  dK+in  and  fn(t,z0)  £  K+  for  all  t  £  [0,T). 

Consider  when  zq  £  Rn  n  U  dl\+div)  c  Rn  n  K+. 

We  claim  that  <j>n(t,  zo)  must  be  contained  in  K+in  U  dK+div 
(and  hence  cannot  enter  K+out)  for  all  t  £  [0,T).  Otherwise, 
< f>n(t ,  Zq)  must  intersect  dK+div  at  some  finite  time  T  £  (0,  T) 
and  then  pass  into  K+out.  Claims  13  and  14  shows  that 
(f>n(t,zo)  must  pass  through  dK+diV  or  a+diV,  which  are 
transverse  sections.  By  similar  reasoning  as  in  the  proof  of 
Claim  15,  cf>n(t,Zo)  can  never  return  to  K+in  during  the 
interval  [T,T\.  In  that  case,  <f>n(t,zf)  can  never  intersect 
dK+in,  which  is  a  contradiction  that  establishes  the  immediate 
claim. 

Since  (j)n(t,  zo)  £  K+in  U  dK+diV  for  all  t  £  [0,  T),  Fact  2 
yields  fg(t,z0)  =  fn(t,z0)  for  all  t  £  [0,T].  Since  z0  £ 
Rn,  we  have  cj>n(t,zo)  £  Rn  for  all  t  >  0.  In  particular, 
we  have  (j)n(T,z0)  =  fg(T,z0)  £  Rn  O  dK+in  C  Rn  D  K. 
Proposition  2  then  shows  that  fg(T,zo)  £  Rg,  so  that  zo  £ 
Rg,  as  desired. 

Next,  consider  when  Zq  £  Rn  D  K+out  C  Rn  0  K+. 
Claim  15  shows  that  there  exists  a  Tg  £  (0,  T)  such  that 
<j)g{Tg,z0)  £  l(z+,  <f>n(T,  zo))  C  dK+.in.  Since  z0  £  Rn  and 
fn(T,z0)  £  dK+in ,  we  have  fn(T,z0)  £  Rn  D  dK+in  C 
Rn  D  K.  Proposition  2  then  shows  that  (f>n(T,zo)  £  Rg. 
Observing  that  </>n(Tjzo)  £  dK+innRg,  Claim  16  shows  that 
l(z+,<f>n(T,z0))  C  K(<f>n(T,  z0))  C  Rg.  Then  ^g(Tg,z0)  £ 
l(z+,(/)n(T,Zo))  C  Rg  implies  z0  £  Rg,  as  desired. 

Finally,  by  observing  that 

(■ Rn  n  (K+in  u  dK+div))  U  (Rn  0  K+out)  =  Rn  O  K+, 

the  conclusion  follows.  ■ 

C.  Main  Result 

The  following  is  the  main  result,  which  shows  that  the 
GPAW  scheme  can  only  maintain/enlarge  the  ROA  of  the 
uncompensated  system.  This  establishes  the  GPAW  scheme 
as  a  valid  anti-windup  method  for  this  simple  system. 


Proposition  4:  The  ROA  of  the  origin  of  system  £n  is 
contained  within  the  ROA  of  the  origin  of  system  Hg,  ie. 
Rn  c  Rg. 

Proof:  Observing  that 

Rn  =  (Rn  n  K)  U  (Rn  D  (R2  \  K)) , 
the  result  follows  immediately  from  Propositions  2  and  3.  ■ 

D.  Numerical  Examples 

Here,  we  show  numerical  results  on  the  exact  ROAs  of 
systems  £„  and  £g.  The  reader  is  reminded  that  in  these 
figures,  the  ROAs  are  to  be  interpreted  as  open  sets,  since 
ROAs  must  be  open  [8,  Lemma  8.1,  pp.  314].  Fig.  5a  shows 
the  case  where  Rn  =  Rg  for  an  open  loop  unstable  system, 
together  with  two  pairs  of  representative  solutions,  when  the 
saturation  constraints  are  symmetric,  ie.  umax  =  —umin- 
When  the  same  system  is  subjected  to  asymmetric  saturation 
constraints,  the  ROAs  are  illustrated  in  Fig.  5b.  Clearly,  the 
set  containment  Rn  C  Rg  is  strict.  In  Fig.  5c,  the  ROAs  are 
illustrated  for  an  open  loop  strictly  stable  system  with  the 
nominal  controller  parameter  chosen  to  satisfy  d  £  (0,  — a). 
Again,  the  set  containment  Rn  C  Rg  is  strict. 

Remark  1 7:  Observe  that  the  case  of  asymmetric  saturation 
constraints  arises  whenever  the  objective  is  to  regulate  about 
an  equilibrium  not  lying  in  {(x,u)  £  R2  |  u  =  0},  and  the 
system  state  is  transformed  such  that  the  resulting  equilibrium 
lies  at  the  origin.  □ 

VII.  A  Paradigm  Shift  in  Anti-windup 
Compensation 

Here,  we  propose  a  new  way  of  addressing  the  general 
anti-windup  problem.  To  aid  in  the  subsequent  discussion, 
we  present  the  next  result,  which  states  that  the  nominal 
uncompensated  system  achieves  global  asymptotic  stability 
(GAS)  and  local  exponential  stability  (LES)  when  both  the 
open  loop  system  and  nominal  controller  are  marginally  or 
strictly  stable. 

Claim  17:  If  in  addition  to  Assumption  1,  both  the  open 
loop  system  and  nominal  controller  are  marginally  or  strictly 
stable  (a  <  0  and  d  <  0),  then  the  origin  of  the  nominal  system 
£„  is  globally  asymptotically  stable  and  locally  exponentially 
stable. 

Remark  18:  This  is  the  main  reason  why  this  case  is  not 
included  in  Fig.  5.  □ 

Proof:  The  proof  follows  [30,  Example  3.14,  pp.  74  - 
75]  closely.  First,  the  nominal  system  E.„  is  governed  by  the 
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Fig.  5:  Numerical  examples  to  illustrate  the  ROAs  of  systems  E.„  and  E9,  which  shows  that  the  ROA  containment  Rn  C  Rg 
of  Proposition  4  can  hold  strictly.  The  vector  field  fn  is  shown  in  the  background,  light  purple  regions  represent  Rn  (C  Rg), 
and  light  blue  regions  represent  Rg  \  Rn.  In  (a),  the  open  loop  system  is  unstable  and  the  saturation  limits  are  symmetrical 
(a  =  1,  b  =  1,  c  =  —3,  d  =  —1.2,  umax  =  — umin  =  1),  resulting  in  Rn  =  Rg.  The  pair  of  solutions  starting  at 
zq  =  (0.85,  —4)  £  Rn  fl  Rg  converges  to  the  origin,  while  the  pair  of  solutions  starting  at  zq  =  (—0.66,4)  ^  Rn  U  Rg  failed 
to  converge  to  the  origin.  Cases  (b)  and  (c)  shows  that  Rn  C  Rg  holds  strictly.  Case  (b)  is  identical  with  case  (a),  except  with 
asymmetric  saturation  limits  (a  =  1,  b  =  1,  c  =  —3,  d  =  —1.2,  umax  =  1.5,  umin  =  —1).  Two  pairs  of  solutions  starting 
from  Zo  =  (0.9,  —1.9)  €  Rn  D  Rg  and  Zq  =  (0.37,  —4.37)  £  Rg\  Rn  are  also  included.  A  case  where  the  open  loop  system 
is  stable  with  an  unstable  controller  is  shown  in  (c)  (a  =  —1,  b  =  1,  c  =  —1,  d  =  0.5,  umax  =  — Umin  =  1),  together  with 
two  pairs  of  solutions  starting  from  zq  =  (—3.7,  —2.54)  £  Rn  (T  Rg  and  zq  =  (4, 1.6)  £  Rg  \  Rn. 


ordinary  differential  equations 

x  =  ax  +  6  sat  (it), 
ii  =  cx  +  du, 

which  can  be  rewritten  as 

u  =  (a  +  d)u  —  adu  +  be  sat  (u).  (14) 

Consider  the  continuously  differentiable  function 

r 

V(u,ii)=\u2  +  /  adr  —  &csat(r)  dr  =  1ft2  +  V(u). 

Jo 

We  will  show  that  V (u,  ii)  is  positive  definite  when  ad  >  0, 
which  is  implied  by  a  <  0  and  d  <  0.  Clearly,  it  is  sufficient  to 
show  that  V(u)  :=  adr  —  6csat(r)  dr  is  positive  definite. 
When  Umin  <u<  umax,  we  have 
ru 

V(u)=  /  (ad  —  bc)r  dr  =  \{ad  —  bc)u2 , 

Jo 

so  that  from  (6),  V(u)  >0  for  all  u  £  [umin,umax]  \  {0}. 
Next,  consider  when  u  =  u  +  umax  >  umax,  where  u  >  0. 
Direct  computation  yields 

pUmax  ru 

V(u)=\adu2—  /  bcr  dr  —  /  bcumaxdr , 

Jo  j  Umax 

=  \adu 2  -  \bcu2max  -  bcuumax, 

—  2ad(ll  -f  2uurnax  timax)  2  bcUUmaxj 

=  \ adu2  +  (ad  -  bc)uumax  +  \  (ad  -  bc)u2max. 


Clearly,  when  ad  >  0,  (6)  implies  V (u)  >  0  for  all  u  >  umax. 
The  case  when  u  <  umln  can  be  shown  similarly.  Hence 
V (u,  u)  is  positive  definite.  The  above  expressions  also  show 
that  V(u,u)  is  radially  unbounded. 

Taking  the  time  derivative  yields 

V(u,  u)  =  uu+  (adu  —  bcs&t(u))u, 

=  u((a  +  d)u  —  adu  +  bcsat(u)) 

+  (adu  —  bcsat(u))u, 

=  (a  +  d)u2 . 

By  (5),  we  have  V(u,u)  <  0,  ie.  negative  semidefinite. 

To  complete  the  proof  for  global  asymptotic  stability,  it  is 
sufficient  to  show  that  V(u,  u)  =  0  implies  ii  =  0  and  u  =  0. 
The  first  condition  is  obtained  immediately.  When  u  =  0,  (14) 
reduces  to 

it  =  —adu  +  &csat(u), 

so  that  it  is  nonzero  as  long  as  it  ^  0.  Hence  only  the 
trivial  solution  u  =  0,  u  =  0  can  stay  identically  in  the  set 
S  =  {(it, it)  £  R2  |  V(u,u)  =  0}.  By  [8,  Corollary  4.2, 
pp.  129],  the  origin  of  En  is  globally  asymptotically  stable. 
Local  exponential  stability  of  the  origin  follows  immediately 
from  Assumption  1.  ■ 

Remark  19:  Observe  that  (5)  precludes  ad  >  0  being 
satisfied  when  either  a  >  0  or  d  >  0.  □ 

Corollary  2:  If  in  addition  to  Assumption  1,  both  the  open 
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loop  system  and  nominal  controller  are  marginally  or  strictly 
stable  (a  <  0  and  d  <  0),  then  the  origin  of  the  GPAW 
compensated  system  Eg  is  globally  asymptotically  stable  and 
locally  exponentially  stable. 

Proof:  Claim  17  shows  that  the  origin  zeq 0  is  globally 
asymptotically  stable  for  system  En,  which  implies  Rn  =  R2. 
Proposition  4  then  yields  Rg  D  Rn  =  R2,  which  implies 
Rg  =  R2  and  that  the  origin  zeq o  is  globally  asymptotically 
stable  for  system  Eg.  Local  exponential  stability  of  the  origin 
for  system  Eg  follows  immediately  from  Assumption  1.  ■ 

Numerous  results  in  the  anti-windup  literature  are  of  the 
form  of  Corollary  2,  ie.  under  some  assumptions  and  apply¬ 
ing  some  anti-windup  method,  some  stability  properties  are 
achieved.  Such  results  sounds  impressive,  and  may  indeed 
give  some  confidence  in  the  application  of  the  particular  anti¬ 
windup  method.  However,  we  argue  that  it  may  not  reveal  any 
advantages  of  the  anti-windup  method.  First,  observe  that  for 
any  meaningful  anti-windup  problem,  local  stability  must  be 
assumed  to  hold.  Otherwise,  the  anti-windup  problem  is  ill- 
posed.  Any  results  asserting  local  stability  are  only  restating 
the  assumption.  Observe  from  Claim  17  that  for  this  example, 
the  uncompensated  system  achieves  GAS.  While  Corollary  2 
asserts  GAS,  it  tells  nothing  of  any  advantages  gained  by 
adopting  the  particular  anti- windup  method. 

In  contrast,  the  ROA  containment  result  of  Proposition  4 
truly  reflects  an  advantage  of  the  GPAW  scheme,  namely,  that 
the  ROA  of  the  system  will  always  be  maintained/enlarged 
by  its  application.  As  such,  we  propose  this  new  paradigm  to 
address  the  anti-windup  problem,  ie.  results  on  the  anti-windup 
compensated  system  relative  to  the  uncompensated  system. 

Conclusion 

We  analyzed  the  gradient  projection  anti-windup  (GPAW) 
scheme  when  applied  to  a  constrained  first  order  LTI  system 
driven  by  a  first  order  LTI  controller,  where  the  objective  is 
to  regulate  the  system  state  about  the  origin.  Existence  and 
uniqueness  of  solutions  are  assured  using  results  from  the 
projected  dynamical  systems  literature,  and  equilibria  are  char¬ 
acterized.  The  main  result  of  this  report  is  that  GPAW  compen¬ 
sation  applied  to  this  simple  system  can  only  maintain/enlarge 
the  system’s  region  of  attraction,  which  renders  it  a  valid  anti¬ 
windup  method.  The  weaknesses  of  some  qualitative  results 
on  anti-windup  methods  are  illustrated,  which  motivated  a  new 
paradigm  for  addressing  the  anti-windup  problem. 

While  these  results  are  attractive,  their  applicability  are 
severely  limited.  Extending  these  results  to  general  MIMO 
nonlinear  systems/controllers  is  a  topic  for  future  work. 
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Appendix  A 

Derivation  of  GPAW  Compensated  Controller 

Here,  we  derive  the  GPAW  compensated  controller  (4)  using 
the  construction  in  [1],  by  enumerating  all  possibilities  of 
the  associated  combinatorial  optimization  subproblem.  The 
transformed  nominal  controller  (3)  is  repeated  here  for  ease 
of  reference 

u  =  fc(u ,  x)  =  cx  +  du. 

First,  there  are  two  saturation  constraints  given  by 

hl(u)  :=U-  Umax  <  0,  h2  (u)  :=  - U  +  Umin  <  0, 

with  associated  constant  gradient  vectors 

V/i-i  =  \7hi(u)  =  1,  V  h'2  =  \7h2(u)  =  —1. 

There  are  three  cases  to  consider,  namely  when  Isat  =  {i  £ 
{1,2}  I  hi(u)  >  0}  =  0,  Isat  =  {1}.  or  lsat  =  {2},  corre¬ 
sponding  to  candidate  solution  sets  J  =  {0},  J  =  {0,  { 1}}, 
or  J  =  {0,  {2}}  respectively.  Thus  the  possible  candidate 
solutions  to  [1,  subproblem  (11)]  are  0,  {1},  or  {2},  and  we 
have  Nq  =  [0],  A^i}  =  [1],  ^{2}  =  [— i*1  accordance  to  the 
definition  in  [1]. 

Remark  20:  Clearly,  the  case  Xsat  =  {1,2}  can  never  occur 

due  tO  Umin  ^  Umax  •  El 

Choosing  any  scalar  T  >  0  and  defining 

fi(u,  x)  =  Rx(u)fc(u,  x)  =  Ri(cx  +  du), 

where 

/  -  riVx  (a^ttVx)-1  Nj,  if  \i\  >  o, 

I,  otherwise, 

the  above  can  be  evaluated  for  any  X  £  {0,  {1},  {2}}  to  be 

!cx  +  du,  if  1=0, 

0,  if  X=  {1}  orX=  {2}. 

The  GPAW  compensated  controller  is  then  given  by 

{  cx  +  du,  if  X*  =  0, 
u  =  /x*  ( u ,  x)  =  < 

I  0,  otherwise, 
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where  X*  is  the  solution  of  [1,  subproblem  (11)],  translated  as 
the  equivalent  combinatorial  optimization  problem 

maxJ(Z)  :=  (cx  +  du)fz(u,x), 

IGJ  (15) 

subject  to  Nj  t\xfx{u,  x)  <  0. 

Observe  that  the  GPAW  compensated  controller  is  independent 
of  r,  and  the  rank  (or  linear  independence)  condition  in  [1, 
subproblem  (11)]  is  automatically  satisfied  for  this  simple 
system. 

Now,  consider  the  three  cases  mentioned  previously.  Clearly, 
when  Tsat  =  0,  ie.  when  no  constraints  are  violated,  X*  =  0 
is  the  optimal  solution  to  problem  (15).  When  Xsat  =  {1},  we 
have  J  =  {0,  {1}}  and  the  objective  function  evaluates  to 

(cx  +  du)2,  if  X  =  0, 

0,  ifj={l}. 

When  cx  +  du  =  0,  it  is  immaterial  whether  X*  is  chosen 
as  0  or  {1}.  When  cx  +  du  ^  0,  inspection  of  the  preceding 
and  (15)  shows  that  X*  =  {1}  only  when  Nj  t\ifi(u,a :)  = 
N1 ]aJi(u>x)  =  Nj-{ }  fi  (u,x)  =  cx  +  du  >  0.  By  similar 
arguments,  we  can  show  that  when  Xsat  =  {2},  the  solution  to 
problem  (15)  is  X*  =  {2}  only  when  cx+du  =  0,  or  cx+du  ^ 
0  and  Nxsat\lfa{'u,  x)  =  NjsaJ^(u,x)  =  Nf2}  f,  (u,  x)  = 
—  ( cx  +  du)  >  0.  Collecting  these  individual  cases,  we  can 
write  the  GPAW  compensated  controller  as 

{0,  if  Xsat  =  {1}  and  cx  +  du  >  0, 

0,  if  Xsat  =  {2}  and  cx  +  du  <  0, 

cx  +  du,  otherwise, 
which  is  equivalent  to  (4). 

Appendix  B 

Simplifying  Some  Logical  Statements 

In  some  of  the  proofs  in  this  report,  we  need  to  assert 
the  truth  of  statements  of  the  form  “if  z  £  a  and  z  £  f3, 
then  z  £  7”.  Here,  we  show  explicitly  that  this  statement  is 
equivalent  to  “if  z  £  a\ 7,  then  2  ^  /3”.  Note  that  -1,  A,  V,  =4, 
44,  represents  logical  negation  (“NOT”  operator),  conjunction 
(“AND”  operator),  disjunction  (“OR”  operator),  implication, 
and  equivalence  respectively. 

Let 

A=(z£a),  B  =  (z£(3),  C  =  (z£  7), 


pp.  210]  to  write  the  original  statement  as 

(. A  A  B)  =4  C  44  —1  (A  A  B)  V  C  44  ~^A  V  ~^B  V  C, 

44  —<A  V  C  V  —<B  44  - i(A  A  —<C)  V  —<B, 

44  (A  A  —<C)  =4  —*B. 

In  other  words,  the  original  statement  is  equivalent  to  “if  z  £  a 
and  z  7,  then  z  (jL  (3”,  or  more  compactly,  “if  z  £  a  \  7, 
then  2  ^  /?”. 

Moreover,  observe  that  we  can  always  replace  A  by  more 
complex  statements  to  get  an  analogous  equivalence  relation. 
For  example,  if  A  =  (D  V  E)  A  F,  then 

{{D  V  E)  A  F  A  B  =4  C)  44  ((D  V  E)  A  F  A  ~^C  =4  ->B). 

In  fact,  the  more  complex  form  is  often  used  in  this  report. 
Appendix  C 

A  Variant  of  the  Comparison  Lemma 
Here,  we  present  a  variant  of  the  Comparison  Lemma  [8, 
Lemma  3.4,  pp.  102  -  103],  where  the  conclusion  results  in  a 
strict  inequality.  It  is  a  direct  consequence  of  uniqueness  of  so¬ 
lutions  of  the  scalar  differential  equation,  with  an  application 
of  the  original  Comparison  Lemma. 

Lemma  1  (Strict  Comparison  Lemma):  Consider  the  scalar 
differential  equation 

u  =  f(t,u),  u(t0)=u0,  (16) 

where  f(t,  u)  is  continuous  in  t  and  locally  Lipschitz  in  u,  for 
all  t  >  0  and  all  u  £  J  C  R,  J  a  connected  set.  Let  [to ,  T)  ( T 
could  be  infinity)  be  the  maximal  interval  of  existence  of  the 
solution  u(t),  and  suppose  u(t)  £  J  for  all  t  £  [t0,T).  Let  v(t) 
be  a  continuous  function  whose  upper  right-hand  derivative 
D+v(t)  satisfies  the  differential  inequality 

D+v(t )  <  f(t,v(t)),  v(t0)  <  u0, 

with  v(t)  £  J  for  all  t  £  [to,T).  Then  v(t)  <  u(t)  for  all 
t  £  [to,  T). 

Remark  21:  Observe  that  the  fundamental  qualitative  differ¬ 
ence  with  [8,  Lemma  3.4,  pp.  102  -  103]  is  the  strict  inequality 
of  the  initial  condition  v(to)  <  uo,  and  the  conclusion 
v(t)  <  u(t)  for  all  t  £  [t0,T).  The  requirement  of  J  being  a 
connected  set  is  purely  technical,  as  seen  in  the  proof.  □ 
Proof:  Consider  the  initial  value  problem 

w=f(t,w),  w(t0)  =  v(t0)  <  u0.  (17) 


so  that  the  original  statement  is  equivalent  to  ( AAB )  =4  C.  We  With  the  assumptions,  [8,  Theorem  3.1,  pp.  88  -  89]  implies 
can  use  the  equivalence  (<j>  =4  6)  44  (->(/>V0)  [31,  Figure  7.11,  existence  and  uniqueness  of  solutions  of  (16)  and  (17).  Let 
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[to,Tw)  be  the  maximal  interval  of  existence  of  the  solution 
w(t)  such  that  w(t)  £  J  for  all  t  £  [; to,Tw ).  Define  T  := 
min  {T,TW}. 

We  claim  that  w(t)  ^  u(t)  for  all  t  £  [to,T)  (due  to 
w(t o)  7^  u(t o)).  Otherwise,  there  exists  a  T  £  [to,T)  such 
that  w(T)  =  u(T).  By  solving  (16)  and  (17)  backwards  in 
time  from  t  =  T  to  t  =  to,  we  obtain  w(to)  =  u(to)  due  to 
uniqueness  of  solutions.  This  contradicts  w(t o)  7^  it(fo)  and 
establishes  the  claim. 

Since  w(t 0)  <  u(t 0),  and  w(t)  ^  u(t )  for  all  t  £  [to,T), 
continuity  of  both  w(t)  and  u{t)  shows  that  w(t)  <  u(t) 
holds  with  strict  inequality  for  all  t  £  [to,  T).  The  Comparison 
Lemma  [8,  Lemma  3.4,  pp.  102  -  103]  applied  to  (17)  and  the 
differential  inequality  yields  v(t)  <  w(t)  for  all  t  £  [to,T). 
Then  we  have  v(t)  <  w(t)  <  u(t)  for  all  t  £  [t0,T). 
This,  together  with  the  connectivity  of  J  and  the  condition 
u(t),v(t)  £  J  for  all  t  £  [to,T)  implies  w(t)  £  J  for  all 
t  £  [to,T),  ie.  Tw  >  T  and  T  =  T.  Hence  the  conclusion 
v(t)  <  u(t)  holds  with  strict  inequality  for  all  t  £  [to,  T).  ■ 
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